-- Logs begin at Thu 2022-05-12 11:02:35 UTC, end at Thu 2022-05-12 12:07:00 UTC. -- May 12 11:35:58.582478 dv-cinder-804735-29-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 11:35:58.590714 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 11:35:58.592804 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 11:35:58 2022] *** May 12 11:35:58.592804 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 11:35:58.592804 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 11:35:58.592804 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: nodename: dv-cinder-804735-29-iscsi May 12 11:35:58.592804 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: machine: x86_64 May 12 11:35:58.592804 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: clock source: unix May 12 11:35:58.592804 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: pcre jit disabled May 12 11:35:58.592804 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: detected number of CPU cores: 4 May 12 11:35:58.592804 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: current working directory: / May 12 11:35:58.592804 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: detected binary path: /usr/bin/uwsgi-core May 12 11:35:58.593521 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: your processes number limit is 47680 May 12 11:35:58.593521 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: your memory page size is 4096 bytes May 12 11:35:58.593521 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: detected max file descriptor number: 2048 May 12 11:35:58.593521 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: lock engine: pthread robust mutexes May 12 11:35:58.593521 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: thunder lock: enabled May 12 11:35:58.593521 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 11:35:58.593521 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 11:35:58.639050 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: Python main interpreter initialized at 0x55f2739f09c0 May 12 11:35:58.639050 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: python threads support enabled May 12 11:35:58.639050 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: your server socket listen backlog is limited to 100 connections May 12 11:35:58.639050 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: your mercy for graceful operations on workers is 90 seconds May 12 11:35:58.639439 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: mapped 403077 bytes (393 KB) for 2 cores May 12 11:35:58.639520 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: *** Operational MODE: preforking *** May 12 11:35:58.639723 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: *** uWSGI is running in multiple interpreter mode *** May 12 11:35:58.639723 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: spawned uWSGI master process (pid: 109154) May 12 11:35:58.639922 dv-cinder-804735-29-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 11:35:58.640483 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: spawned uWSGI worker 1 (pid: 109155, cores: 1) May 12 11:35:58.640832 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: spawned uWSGI worker 2 (pid: 109156, cores: 1) May 12 11:35:58.640990 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 11:35:59.822775 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 11:35:59.833105 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 11:36:00.552197 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 11:36:00.552197 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: from cryptography.utils import int_from_bytes May 12 11:36:00.552524 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 11:36:00.552524 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: from cryptography.utils import int_from_bytes May 12 11:36:00.555991 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 11:36:00.555991 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: from cryptography.utils import int_from_bytes May 12 11:36:00.556338 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 11:36:00.556338 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: from cryptography.utils import int_from_bytes May 12 11:36:03.132725 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 11:36:03.133426 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 11:36:03.133511 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 11:36:03.133923 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 11:36:03.134189 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 11:36:03.134580 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.134911 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.135238 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.135566 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.135903 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.136221 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.136548 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.136877 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.137209 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.137312 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 11:36:03.137732 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.137840 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 11:36:03.137931 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.138073 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 11:36:03.138170 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-29-iscsi {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.138436 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 11:36:03.138620 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.138710 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 11:36:03.138793 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.139048 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.139171 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.139371 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.139473 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.139677 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.139770 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.139993 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.140095 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.140312 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.140399 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.140622 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.140815 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.140924 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.141252 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.141372 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.141560 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.141651 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.141841 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.141943 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.142151 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.142251 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.142473 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-29-iscsi {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.142585 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.142817 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.142935 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.143130 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.143259 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.143436 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.143530 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.143753 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.143864 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.144057 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.144163 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.144379 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.144490 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-29-iscsi {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.144683 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.144829 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.145089 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.145230 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.145390 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.145531 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.145790 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.145898 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.146102 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.146200 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.146435 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.146532 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.146747 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.146835 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.147054 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.147141 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.147370 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.147459 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.147672 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.147759 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.147992 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.148092 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.148299 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.148396 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.148634 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.148731 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-29-iscsi {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.148942 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.149030 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.149255 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.149355 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.149568 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.149664 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.149916 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.150019 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.150232 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.150335 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.150539 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.150634 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.150794 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.150892 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.151105 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.151205 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.151430 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.151525 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.151756 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.151844 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.152084 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.152176 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.152340 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.152435 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.152597 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.152703 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.152922 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.153026 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.153250 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.153357 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.153563 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.153744 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.153897 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.153995 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.154198 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.154293 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.154502 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.154606 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.154752 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.154847 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.155056 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.155150 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.155370 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.155467 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.155687 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.155785 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.156006 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.156105 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.156255 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.156344 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.156501 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.156637 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.156819 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.156951 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.157138 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.157274 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.157445 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.157680 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.157812 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.157959 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.158058 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.158273 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.158372 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.158645 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.158741 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.158963 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.159057 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.159267 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.159370 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.159571 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.159668 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.159888 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.159977 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.160201 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.160300 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.160513 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.160600 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.160816 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.160903 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.161134 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.161229 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.161462 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.161561 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.161795 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.161899 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.162055 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.162143 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.162362 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.162466 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.162678 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.162773 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.163017 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.163152 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.163317 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.163414 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.163632 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.163762 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.163937 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.164026 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.164244 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.164414 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.164545 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.164638 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.164854 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.164947 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.165165 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.165265 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.165466 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.165558 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.165758 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.165861 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.166035 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.166140 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.166342 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.166431 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.166658 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.166746 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.166962 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.167058 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.167264 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.167352 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.167569 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.167664 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.167868 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.167959 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.168171 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.168259 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.168475 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.168562 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.168779 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.168883 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.169079 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.169166 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.169380 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.169474 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.169684 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.169794 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.170010 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.170109 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.170313 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.170400 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.170618 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.170707 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.170934 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.171028 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.171252 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.171345 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.171553 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.171650 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.171858 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.171958 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.172161 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.172262 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.172464 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.172560 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.172782 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.172870 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.173087 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.173169 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.173391 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.173488 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.173737 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.173874 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.174525 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.174631 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.174840 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.174930 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.175150 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.175236 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.175453 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.175549 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.175758 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.175853 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.176062 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.176148 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.176360 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.176456 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.176664 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.176751 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.176979 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.177068 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.177284 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.177425 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.177588 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.177675 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.177913 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.178005 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.178216 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.178305 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.178519 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.178606 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.178822 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.178919 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.179124 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.179220 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.179425 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.179556 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.179723 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.179895 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.180037 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.180228 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.180355 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.180549 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.180662 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.180871 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.180968 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.181205 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.181300 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.181523 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.181610 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:36:03.181864 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.181955 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.182186 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.182274 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.182512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.182608 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.182837 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.182925 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.183169 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.183265 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.183487 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.183583 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.183801 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.183895 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.184113 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.184206 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.184425 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.184526 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.184745 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.184846 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.185054 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.185147 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.185363 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.185457 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.185672 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.185843 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.186010 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.186105 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.186326 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.186423 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.186656 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.186745 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.186970 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.187068 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.187286 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.187383 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.187603 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.187693 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.187911 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.188005 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.188227 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.188329 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.188554 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.188651 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.188872 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.188959 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.189181 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.189282 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.189511 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.189599 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.190426 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.190538 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.190741 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.190840 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.191058 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.191145 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.191377 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.191465 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.191684 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.191772 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.191992 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.192082 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.192301 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.192397 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.192618 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.192708 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.192941 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.193028 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.193503 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.193597 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.193844 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.193947 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.194158 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.194249 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.194467 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.194563 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.194775 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.194865 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.195084 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.195171 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.195394 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.195489 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.195709 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.195796 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.196021 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.196109 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.196333 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.196429 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.196641 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.196737 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.196957 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.197046 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.197266 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.197366 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.197575 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.197664 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.197904 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.197994 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.198208 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.198312 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.198513 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.198601 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.198814 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.198909 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.199118 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.199219 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.199421 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.199515 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.199735 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.199822 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.200057 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.200152 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.200361 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.200460 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.200676 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.200771 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.200982 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.201071 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.201296 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.201385 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.201602 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.201689 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.201932 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.202020 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.202232 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.202321 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.202551 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.202644 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.202868 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.202957 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.203183 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.203288 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.203511 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.203608 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.203826 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.203915 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.204127 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.204266 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.204451 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.204560 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.204753 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.204841 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.205056 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.205143 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.205389 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.205491 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.205716 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.205821 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.206028 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.206123 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.206336 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.206438 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.206642 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.206731 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.206962 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.207058 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.207270 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.207369 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.207577 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.207713 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.207889 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.207982 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.208196 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.208285 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.208506 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.208594 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.208816 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.208947 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.209124 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.209213 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.209432 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.209522 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.209751 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.209854 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.210063 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.210152 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.210366 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.210454 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.210670 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.210772 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.210971 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.211059 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.211284 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.211381 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.211589 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.211686 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.211894 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.211990 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.212197 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.212293 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.212502 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.212604 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.212803 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.212891 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.213123 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.213217 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.213430 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.213526 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.213750 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.213852 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.214056 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.214144 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.214358 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.214454 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.214699 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.214787 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.215004 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.215099 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.215341 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.215439 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.215662 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.215749 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.215976 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.216062 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.216296 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.216385 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.216605 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.216695 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.216919 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.217006 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.217227 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.217322 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.217532 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.217619 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.217866 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.217974 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.218177 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.218267 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.218494 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.218582 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.218802 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.218900 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.219119 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.219213 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.219426 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.219515 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.219747 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.219842 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.220054 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.220141 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.220369 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.220464 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.220672 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.220773 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.221010 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.221110 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.221324 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.221410 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.221647 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.221755 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.221986 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.222074 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.222310 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.222396 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.222620 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.222709 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.222932 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.223033 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.223238 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.223336 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.223544 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.223632 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.223852 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.223939 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.224160 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.224247 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.224476 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.224577 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.224785 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.224873 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.225098 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.225187 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.225406 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.225501 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.225749 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.225841 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.226045 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.226150 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.226352 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.226446 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.226653 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.226740 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.226963 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.227059 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.227279 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.227365 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.227592 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.227687 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.227899 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.227995 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.228209 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.228296 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.228524 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.228611 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.228835 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.228930 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.229139 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.229233 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.229443 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.229530 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.229766 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.229868 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.230072 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.230161 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.230380 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.230476 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.230692 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.230781 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.231004 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.231091 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.231309 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.231398 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.231610 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.231699 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.231920 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.232017 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.232224 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.232312 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.232526 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.232615 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.232824 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.232912 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.233131 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.233226 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.233447 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.233541 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.233777 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.233909 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.234099 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.234208 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.234417 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.234540 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.234715 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.234803 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.235016 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.235113 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.235335 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.235423 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.235641 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.235729 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.235942 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.236039 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.236241 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.236336 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.237051 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.237147 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.237385 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.237481 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.237692 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.237806 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.238016 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.238104 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.238329 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.238418 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.238641 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.238729 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.238955 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.239049 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.239256 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.239352 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.239563 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.239655 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.239868 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.239956 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.240174 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.240261 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.240481 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.240567 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.240786 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.240883 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.241093 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.241367 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.241460 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.241696 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.241815 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.242023 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.242113 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.242343 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.242430 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.242649 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.242737 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.242958 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.243047 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.243262 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.243350 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.243561 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.243648 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.243867 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.243995 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.244182 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.244281 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.244579 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.244736 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.244894 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.245065 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.245205 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.245377 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.245522 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.245690 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.245859 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.246028 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.246172 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.246343 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.246482 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.246670 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.246797 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.246992 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.247108 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.247327 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.247433 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.247630 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.247719 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.247937 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.248032 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.248240 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.248328 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.248543 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.248631 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.248851 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.248940 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.249152 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.249250 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.249455 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.249543 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.249777 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.249872 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.250085 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.250185 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.250386 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.250475 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.250690 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.250779 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.250990 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.251079 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.251297 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.251394 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.251608 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.251696 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.251910 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.251997 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.252758 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.252897 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.253070 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.253212 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.253391 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.253525 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.253694 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.253883 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.254076 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.254198 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.254312 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.254507 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.254604 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.254818 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.254943 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.255133 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.255247 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.255446 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.255583 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.255756 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.255910 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.256073 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.256249 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.256388 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.256555 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.256702 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.256857 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.257017 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.257179 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.257327 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.257484 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.257641 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.257810 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.258041 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.258129 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.258362 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.258462 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.258677 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.258767 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.258990 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.259104 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.259295 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.259390 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.259602 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.259690 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.259907 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.259995 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.260213 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.260300 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.260510 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.260596 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.260818 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.260906 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.261121 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.261219 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.261430 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.261517 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.261751 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.261843 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.262054 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.262144 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.262353 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.262441 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.262659 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.262756 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.262963 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.263052 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.263260 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.263348 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.263565 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.263661 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.263866 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.263954 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.264176 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.264275 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.264475 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.264583 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.264779 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.264916 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.265077 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.265168 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.265382 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.265479 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.265686 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.265795 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.266007 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.266096 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.266329 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.266426 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.266636 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.266731 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.266937 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.267032 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.267237 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.267326 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.267542 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.267629 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.267864 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.267949 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.268165 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.268255 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.268468 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.268556 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.268780 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.268868 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.269080 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.269215 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.269378 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.269466 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.269683 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.269824 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.270005 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.270096 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.270306 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.270395 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.270606 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.270704 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.270908 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.270997 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.271213 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.271302 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.271513 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.271611 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.271813 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.271902 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.272112 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.272199 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.272411 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.272517 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.272731 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.272819 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.273034 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.273134 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.273334 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.273423 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.273633 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.273740 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.273965 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.274054 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.274306 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.274407 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.274605 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.274692 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.274919 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.275052 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.275229 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.275318 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.275537 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.275624 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.275849 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.275937 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.276155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.276251 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.276461 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.276550 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.276772 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.276861 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.277073 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.277162 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.277383 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.277471 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.277689 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.277845 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.278018 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.278114 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.278318 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.278444 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.278618 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.278721 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.278928 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.279014 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.279233 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.279363 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.279538 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.279641 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.279851 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.279937 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.280164 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.280251 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.280478 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.280579 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.280776 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.280862 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.281087 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.281174 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.281393 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.281482 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.281715 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.281806 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.282022 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.282123 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.282328 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.282426 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.282634 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.282723 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.282941 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.283027 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.283247 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.283335 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.283578 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.283667 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.283885 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.283980 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.284189 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.284278 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.284496 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.284673 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.284798 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.284989 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.285101 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.285306 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.285424 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.285617 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.285748 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.285960 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.286050 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.286276 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.286365 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.286597 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.286684 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.286916 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.287008 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.287214 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.287308 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.287637 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.287725 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.287948 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.288037 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.288255 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.288354 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.288558 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.288655 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.288866 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.288952 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.289171 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.289257 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.289484 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.289579 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.289816 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.289919 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.290121 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.290211 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.290431 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.290527 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.290740 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.290828 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.291072 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.291168 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.291380 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.291477 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.291706 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.291794 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.292005 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.292130 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.292313 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.292445 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.292634 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.292756 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.292935 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.293177 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.293275 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.293493 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.293581 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.293836 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.293927 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.294144 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.294248 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.294463 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.294619 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.294798 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.294886 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.295108 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.295205 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.295427 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.295515 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.295741 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.295835 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.296068 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.296157 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.296399 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.296513 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.296714 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.296803 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.297032 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.297120 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.297342 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.297438 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.297642 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.297750 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.297981 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.298070 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.298289 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.298379 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.298611 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.298699 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.298929 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.299535 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.299753 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.299870 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.300063 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.300187 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.300364 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.300512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.300683 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.300841 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.301005 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.301153 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.301316 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.301469 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.301635 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.301806 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.302072 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.302161 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.302390 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.302490 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.302697 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.302790 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.303014 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.303102 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.303326 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.303423 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.303641 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.303729 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.303954 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.304042 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.304264 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.304365 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.304570 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.304695 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.304877 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.304966 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.305197 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.305287 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.305509 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.305597 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.305843 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.305936 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.306154 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.306244 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.306459 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.306548 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.306758 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.306846 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.307061 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.307151 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.307388 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.307475 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.307687 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.307774 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.307993 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.308082 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.308303 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.308390 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.308621 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.308792 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.308936 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.309026 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.309238 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.309335 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.309556 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.309656 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.309888 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.309995 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.310190 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.310286 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.310489 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.310587 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.310794 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.310882 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.311130 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.311219 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.311433 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.311535 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.311750 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.311840 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.312077 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.312165 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.312402 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.312494 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.312713 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.312808 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.313024 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.313114 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.313334 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.313430 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.313643 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.313751 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.313981 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.314070 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.314290 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.314388 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.314590 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.314708 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.315445 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.315542 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.315753 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.315843 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.316056 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.316145 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.316358 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.316525 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.316660 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.316750 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.316964 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.317054 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.317264 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.317361 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.317567 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.317656 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.317891 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.317982 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.318469 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.318579 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.318772 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.318908 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.319091 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.319192 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.319398 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.319496 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.319699 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.319840 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.319999 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.320088 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.320299 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.320400 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.320637 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.320725 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.320942 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.321038 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.321270 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.321360 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.321582 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.321672 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.321927 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.322027 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.322248 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.322337 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.322567 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.322657 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.322880 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.322969 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.323200 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.323295 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.323508 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.323596 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.323823 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.323988 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.324133 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.324345 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.324434 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.324681 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.324771 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.325002 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.325094 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.325321 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.325411 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.325631 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.325760 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.325970 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.326061 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.326284 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.326374 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.326600 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.326800 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.326899 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.327128 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.327218 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.327442 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.327531 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.327753 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.327843 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.328063 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.328153 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.328373 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.328461 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.328682 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.328772 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.328990 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.329079 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.329298 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.329396 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.329605 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.329695 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.329938 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.330028 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.330280 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.330448 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.330602 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.330771 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.330931 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.331084 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.331263 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.331411 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.331577 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.331731 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.331891 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.332052 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.332203 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.332369 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.332514 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.332684 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.332865 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.333002 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.333176 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.333320 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.333480 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.333634 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.333815 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.333974 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.334133 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.334315 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.334443 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.334634 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.334749 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.334965 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.335054 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.335307 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.335397 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.335632 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.335760 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.335945 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.336044 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.336253 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.336350 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.336563 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.336661 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.336874 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.337082 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.337194 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.337401 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.337524 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.337755 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.337861 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.338089 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.338178 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.338420 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.338516 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.338743 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.338833 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.339068 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.339270 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.339390 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.339581 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.339713 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.339912 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.340045 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.340237 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.340327 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.340559 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.340649 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.340877 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.340965 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.341191 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.341279 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.341514 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.341606 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.341839 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.341930 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.342143 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.342232 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.342451 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.342542 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.342756 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.342987 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.343077 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.343341 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.343445 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.343654 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.343743 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.343953 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.344049 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.344271 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.344367 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.344576 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.344665 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.344906 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.345101 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.345240 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.345442 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.345554 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.345780 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.346442 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.346741 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.346846 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.347061 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.347151 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.347374 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.347462 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.347678 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.347767 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.347994 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.348083 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.348297 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.348384 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.348600 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.348690 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.348913 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.349001 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.349221 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.349308 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.349523 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.349612 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.349851 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.349960 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.350160 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.350250 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.350468 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.350561 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.350771 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.350861 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.351079 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.351180 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.351377 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.351472 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.351691 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.351778 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.351992 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.352093 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.352295 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.352384 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.352597 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.352693 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.352904 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.353003 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.353205 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.353301 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.353506 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.353595 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.353834 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.354004 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.354141 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.354226 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.354432 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.354522 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.354734 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.354833 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.355038 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.355127 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.355337 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.355426 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.355643 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.355733 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.355942 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.356030 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.356248 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.356337 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.356594 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.356684 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.356913 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.357001 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.357213 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.357303 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.357513 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.357603 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.357853 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.358113 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.358203 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.358454 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.358559 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.358763 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.358851 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.359070 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.359158 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.359409 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.359499 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.359722 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.359809 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.360035 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.360247 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.360349 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.360576 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.360666 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.360900 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.360989 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.361227 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.361326 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.361608 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.362218 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.362438 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.362744 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.362846 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.363049 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.363138 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.363368 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.363457 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.363675 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.363779 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.363982 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.364078 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.364290 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.364379 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.364597 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.364695 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.364904 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.364999 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.365210 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.365339 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.365517 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.365608 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.365850 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.365944 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.366156 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.366259 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.366461 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.366559 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.366766 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.366857 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.367069 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.367157 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.367379 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.367470 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.367710 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.367799 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.368022 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.368117 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.368334 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.368424 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.368645 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.368734 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.368958 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.369060 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.369263 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.369352 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.369574 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.369679 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.369903 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.370043 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.370210 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.370354 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.370521 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.370674 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.370853 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.371002 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.371165 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.371323 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.371464 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.371648 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.371876 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.371967 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.372185 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.372274 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.372499 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.372597 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.372815 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.372912 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.373121 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.373216 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.373438 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.373526 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.373783 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.373878 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.374093 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.374185 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.374416 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.374520 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.374723 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.374813 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.375047 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.375137 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.375379 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.375475 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.375701 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.375789 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.376013 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.376108 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.376312 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.376410 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.376614 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.376705 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.376913 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.377011 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.377254 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.377346 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.377564 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.377652 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.377898 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.377987 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.378201 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.378291 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.378503 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.378602 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.378809 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.378898 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.379106 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.379195 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.379407 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.379545 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.379709 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.379798 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.380008 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.380098 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.380311 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.380447 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.380607 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.380705 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.380912 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.381001 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.381210 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.381301 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.381508 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.381607 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.381846 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.381963 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.382132 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.382223 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.382436 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.382540 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.382780 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.382876 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.383033 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.383123 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.383331 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.383497 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.383629 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.383719 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.383927 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.384025 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.384252 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.384343 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.384580 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.384676 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.384890 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.384986 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.385209 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.385300 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.385517 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.385607 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.385856 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.385947 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.386164 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.386294 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.386482 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.386571 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.386796 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.386884 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.387107 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.387197 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.387411 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.387507 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.387723 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.387824 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.388033 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.388122 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.388340 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.388429 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.388650 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.388748 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.388958 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.389046 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.389265 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.389353 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.389571 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.389668 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.389916 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.390018 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.390229 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.390316 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.390534 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.390633 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.390861 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.390951 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.391173 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.391266 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.391488 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.391576 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.391801 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.391889 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.392105 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.392193 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.392423 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.392511 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.392748 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.392848 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.393113 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.393446 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.393797 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.394133 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.394485 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.394804 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.395154 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.395324 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.395489 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.395658 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.395809 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.395984 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.396125 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.396308 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.396444 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.396638 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.396727 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 11:36:03.396963 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.397299 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.397632 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.398079 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.398409 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.398758 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.399076 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.399424 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.399763 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.400205 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.400525 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.400835 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:36:03.401077 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 11:36:03.423587 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_db.sqlalchemy.engines [None req-c4d4009e-fff0-45b7-9467-c7a827c40367 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 11:36:03.425567 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG oslo_db.sqlalchemy.engines [None req-12a3eb14-2f48-4ef2-b042-cc0ddef02081 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109155) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 11:36:03.489036 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.context [None req-c4d4009e-fff0-45b7-9467-c7a827c40367 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7415e0ef-d04b-4a91-9f1a-2fb932d8b170(cell1) {{(pid=109156) load_cells /opt/stack/nova/nova/context.py:464}} May 12 11:36:03.493368 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_concurrency.lockutils [None req-c4d4009e-fff0-45b7-9467-c7a827c40367 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:36:03.494985 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_concurrency.lockutils [None req-c4d4009e-fff0-45b7-9467-c7a827c40367 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:36:03.495785 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_concurrency.lockutils [None req-c4d4009e-fff0-45b7-9467-c7a827c40367 None None] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:36:03.496470 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.context [None req-12a3eb14-2f48-4ef2-b042-cc0ddef02081 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7415e0ef-d04b-4a91-9f1a-2fb932d8b170(cell1) {{(pid=109155) load_cells /opt/stack/nova/nova/context.py:464}} May 12 11:36:03.497749 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_concurrency.lockutils [None req-c4d4009e-fff0-45b7-9467-c7a827c40367 None None] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:36:03.500989 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG oslo_concurrency.lockutils [None req-12a3eb14-2f48-4ef2-b042-cc0ddef02081 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:36:03.502447 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG oslo_concurrency.lockutils [None req-12a3eb14-2f48-4ef2-b042-cc0ddef02081 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:36:03.503254 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG oslo_concurrency.lockutils [None req-12a3eb14-2f48-4ef2-b042-cc0ddef02081 None None] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:36:03.505204 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG oslo_concurrency.lockutils [None req-12a3eb14-2f48-4ef2-b042-cc0ddef02081 None None] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:36:03.509100 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_db.sqlalchemy.engines [None req-c4d4009e-fff0-45b7-9467-c7a827c40367 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 11:36:03.513047 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_db.sqlalchemy.engines [None req-c4d4009e-fff0-45b7-9467-c7a827c40367 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 11:36:03.518186 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG oslo_db.sqlalchemy.engines [None req-12a3eb14-2f48-4ef2-b042-cc0ddef02081 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109155) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 11:36:03.521779 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG oslo_db.sqlalchemy.engines [None req-12a3eb14-2f48-4ef2-b042-cc0ddef02081 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109155) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 11:36:03.675891 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_db.sqlalchemy.engines [None req-c4d4009e-fff0-45b7-9467-c7a827c40367 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 11:36:03.682494 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG oslo_db.sqlalchemy.engines [None req-12a3eb14-2f48-4ef2-b042-cc0ddef02081 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109155) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 11:36:04.020905 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: WARNING keystonemiddleware.auth_token [None req-12a3eb14-2f48-4ef2-b042-cc0ddef02081 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 11:36:04.023483 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: WARNING keystonemiddleware.auth_token [None req-c4d4009e-fff0-45b7-9467-c7a827c40367 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 11:36:04.028353 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: WARNING keystonemiddleware.auth_token [None req-12a3eb14-2f48-4ef2-b042-cc0ddef02081 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 11:36:04.030833 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: WARNING keystonemiddleware.auth_token [None req-c4d4009e-fff0-45b7-9467-c7a827c40367 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 11:36:04.374526 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: WARNING keystonemiddleware.auth_token [None req-12a3eb14-2f48-4ef2-b042-cc0ddef02081 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 11:36:04.375386 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: WARNING keystonemiddleware.auth_token [None req-c4d4009e-fff0-45b7-9467-c7a827c40367 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 11:36:04.381137 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: WARNING keystonemiddleware.auth_token [None req-12a3eb14-2f48-4ef2-b042-cc0ddef02081 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 11:36:04.382049 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: WARNING keystonemiddleware.auth_token [None req-c4d4009e-fff0-45b7-9467-c7a827c40367 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 11:36:04.387257 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f2739f09c0 pid: 109155 (default app) May 12 11:36:04.388107 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f2739f09c0 pid: 109156 (default app) May 12 11:36:04.389306 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-12a3eb14-2f48-4ef2-b042-cc0ddef02081 None None] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:36:04.390536 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-12a3eb14-2f48-4ef2-b042-cc0ddef02081 None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001774 May 12 11:36:04.390957 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Thu May 12 11:36:04 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:37:21.814377 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-c4d4009e-fff0-45b7-9467-c7a827c40367 None None] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:37:21.815599 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-c4d4009e-fff0-45b7-9467-c7a827c40367 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002037 May 12 11:37:21.815995 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 1/2] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 12 11:37:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:37:22.239677 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-a263e187-e407-4c19-9a99-c0acae622b6a admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:37:22.269596 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-a263e187-e407-4c19-9a99-c0acae622b6a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.447472 May 12 11:37:22.270279 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 2/3] 10.222.0.58 () {60 vars in 1291 bytes} [Thu May 12 11:37:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:37:24.576051 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-c4d4009e-fff0-45b7-9467-c7a827c40367 None None] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:37:24.577065 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-c4d4009e-fff0-45b7-9467-c7a827c40367 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 12 11:37:24.577654 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 2/4] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 12 11:37:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:37:24.637802 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-e9de8194-af36-4da2-a556-002891ccc230 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "id": "c1", "swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:37:24.657104 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 11:37:24.657104 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: warnings.warn(msg) May 12 11:37:24.688949 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-e9de8194-af36-4da2-a556-002891ccc230 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104601 May 12 11:37:24.689728 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 3/5] 10.222.0.58 () {64 vars in 1282 bytes} [Thu May 12 11:37:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 11:37:24.910730 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-7b5a9c60-939a-4166-9f76-039bcaae2106 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:37:24.913254 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 11:37:24.913254 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: warnings.warn(msg) May 12 11:37:24.964170 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-7b5a9c60-939a-4166-9f76-039bcaae2106 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.266196 May 12 11:37:24.964975 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 3/6] 10.222.0.58 () {64 vars in 1335 bytes} [Thu May 12 11:37:24 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:37:27.264689 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-e9de8194-af36-4da2-a556-002891ccc230 admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:37:27.265726 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-e9de8194-af36-4da2-a556-002891ccc230 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 May 12 11:37:27.266148 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 4/7] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 12 11:37:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:37:27.370088 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-37b39c43-0880-4f72-9416-9b4a83f56bb3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "id": "d1", "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:37:27.388310 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 11:37:27.388310 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: warnings.warn(msg) May 12 11:37:27.411531 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-37b39c43-0880-4f72-9416-9b4a83f56bb3 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139261 May 12 11:37:27.412090 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 4/8] 10.222.0.58 () {64 vars in 1282 bytes} [Thu May 12 11:37:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 11:37:27.423589 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-43576afa-af40-4923-aebe-171bec352eae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:37:27.425110 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 11:37:27.425110 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: warnings.warn(msg) May 12 11:37:27.460412 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-43576afa-af40-4923-aebe-171bec352eae admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040400 May 12 11:37:27.461000 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 5/9] 10.222.0.58 () {64 vars in 1335 bytes} [Thu May 12 11:37:27 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:37:29.750573 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-37b39c43-0880-4f72-9416-9b4a83f56bb3 admin admin] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:37:29.751591 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-37b39c43-0880-4f72-9416-9b4a83f56bb3 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 May 12 11:37:29.751992 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 5/10] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 12 11:37:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:37:29.819669 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-87558d7e-682b-464c-8728-5b08b39a0154 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "ds1G", "disk": 10, "id": "d2"}} {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:37:29.839565 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-87558d7e-682b-464c-8728-5b08b39a0154 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081119 May 12 11:37:29.840287 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 6/11] 10.222.0.58 () {64 vars in 1282 bytes} [Thu May 12 11:37:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 11:37:29.851963 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-791c4630-fac2-41b8-8a82-e990f5434898 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:37:29.876283 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-791c4630-fac2-41b8-8a82-e990f5434898 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028249 May 12 11:37:29.877735 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 6/12] 10.222.0.58 () {64 vars in 1335 bytes} [Thu May 12 11:37:29 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (3 switches on core 0) May 12 11:37:32.235273 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-87558d7e-682b-464c-8728-5b08b39a0154 admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:37:32.236295 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-87558d7e-682b-464c-8728-5b08b39a0154 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 12 11:37:32.236744 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 7/13] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 12 11:37:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:37:32.302476 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-d62a0003-72c6-4c94-9680-886b6f4d496c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "id": "d3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:37:32.320914 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-d62a0003-72c6-4c94-9680-886b6f4d496c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078012 May 12 11:37:32.321466 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 7/14] 10.222.0.58 () {64 vars in 1282 bytes} [Thu May 12 11:37:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 11:37:32.333596 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-d875c161-0006-4371-b746-37cabdda087b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:37:32.357393 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-d875c161-0006-4371-b746-37cabdda087b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028092 May 12 11:37:32.358209 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 8/15] 10.222.0.58 () {64 vars in 1335 bytes} [Thu May 12 11:37:32 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:37:34.619673 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-d62a0003-72c6-4c94-9680-886b6f4d496c admin admin] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:37:34.620691 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-d62a0003-72c6-4c94-9680-886b6f4d496c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 May 12 11:37:34.621095 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 8/16] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 12 11:37:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:37:34.680922 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-8cd96e32-c7c4-4497-9fe0-01f34e2ec0fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "ds4G", "disk": 20, "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:37:34.699591 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-8cd96e32-c7c4-4497-9fe0-01f34e2ec0fb admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072451 May 12 11:37:34.700295 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 9/17] 10.222.0.58 () {64 vars in 1282 bytes} [Thu May 12 11:37:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 11:37:34.712537 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-f2885592-fdca-49a9-8725-79bff6af1638 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:37:34.736325 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-f2885592-fdca-49a9-8725-79bff6af1638 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027231 May 12 11:37:34.743704 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 9/18] 10.222.0.58 () {64 vars in 1335 bytes} [Thu May 12 11:37:34 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:37:36.962321 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-8cd96e32-c7c4-4497-9fe0-01f34e2ec0fb admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:37:36.963366 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-8cd96e32-c7c4-4497-9fe0-01f34e2ec0fb admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 May 12 11:37:36.964182 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 10/19] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 12 11:37:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:37:37.026605 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-931df090-8a5c-498a-a7f2-f5ca4264ab6f admin admin] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:37:37.051441 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-931df090-8a5c-498a-a7f2-f5ca4264ab6f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080551 May 12 11:37:37.052083 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 10/20] 10.222.0.58 () {60 vars in 1291 bytes} [Thu May 12 11:37:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:37:39.352385 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-8cd96e32-c7c4-4497-9fe0-01f34e2ec0fb admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:37:39.353681 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-8cd96e32-c7c4-4497-9fe0-01f34e2ec0fb admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001942 May 12 11:37:39.354350 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 11/21] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 12 11:37:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:37:39.416787 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-21f3e266-0ec2-4e4d-a285-069f9015e8ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "ram": 512, "vcpus": 1, "disk": 1, "id": "1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny"}} {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:37:39.436431 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-21f3e266-0ec2-4e4d-a285-069f9015e8ee admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074893 May 12 11:37:39.436993 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 11/22] 10.222.0.58 () {64 vars in 1282 bytes} [Thu May 12 11:37:39 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 11:37:39.452621 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-f2bd4a0e-f3ff-4664-82b1-8ce562c10ed0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:37:39.479965 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-f2bd4a0e-f3ff-4664-82b1-8ce562c10ed0 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032074 May 12 11:37:39.480849 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 12/23] 10.222.0.58 () {64 vars in 1332 bytes} [Thu May 12 11:37:39 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:37:41.815516 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-21f3e266-0ec2-4e4d-a285-069f9015e8ee admin admin] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:37:41.816533 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-21f3e266-0ec2-4e4d-a285-069f9015e8ee admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 May 12 11:37:41.816973 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 12/24] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 12 11:37:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:37:41.891138 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-47a9352a-e121-4ef8-bc8e-feba7e01bb59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.small"}} {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:37:41.912930 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-47a9352a-e121-4ef8-bc8e-feba7e01bb59 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.089276 May 12 11:37:41.913513 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 13/25] 10.222.0.58 () {64 vars in 1282 bytes} [Thu May 12 11:37:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 11:37:41.925628 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-eaed8e2e-58cf-4fa7-b239-0848d0324fcd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:37:41.951564 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-eaed8e2e-58cf-4fa7-b239-0848d0324fcd admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029694 May 12 11:37:41.952165 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 13/26] 10.222.0.58 () {64 vars in 1332 bytes} [Thu May 12 11:37:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:37:44.321446 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-47a9352a-e121-4ef8-bc8e-feba7e01bb59 admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:37:44.322504 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-47a9352a-e121-4ef8-bc8e-feba7e01bb59 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 May 12 11:37:44.323020 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 14/27] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 12 11:37:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:37:44.380419 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-afdccb63-5a2e-4abf-bd82-272a486bdf62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "name": "m1.medium", "disk": 40, "id": "3"}} {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:37:44.400638 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-afdccb63-5a2e-4abf-bd82-272a486bdf62 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071525 May 12 11:37:44.401281 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 14/28] 10.222.0.58 () {64 vars in 1282 bytes} [Thu May 12 11:37:44 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 11:37:44.413361 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-5c904457-c9e1-4478-9f9f-1de4193da463 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:37:44.436004 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-5c904457-c9e1-4478-9f9f-1de4193da463 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026239 May 12 11:37:44.436595 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 15/29] 10.222.0.58 () {64 vars in 1332 bytes} [Thu May 12 11:37:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:37:46.737099 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-afdccb63-5a2e-4abf-bd82-272a486bdf62 admin admin] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:37:46.738140 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-afdccb63-5a2e-4abf-bd82-272a486bdf62 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001948 May 12 11:37:46.738537 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 15/30] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 12 11:37:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:37:46.796692 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-6dd1f54b-a351-4c5f-b55a-80b7cecee9e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "id": "4", "rxtx_factor": 1.0, "ram": 8192, "disk": 80, "os-flavor-access:is_public": true, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:37:46.816114 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-6dd1f54b-a351-4c5f-b55a-80b7cecee9e2 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071810 May 12 11:37:46.816830 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 16/31] 10.222.0.58 () {64 vars in 1282 bytes} [Thu May 12 11:37:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 11:37:46.829371 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-f4d1244e-63c1-4262-ae37-dc8654aa1f47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:37:46.853012 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-f4d1244e-63c1-4262-ae37-dc8654aa1f47 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028100 May 12 11:37:46.853593 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 16/32] 10.222.0.58 () {64 vars in 1332 bytes} [Thu May 12 11:37:46 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:37:49.132542 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-6dd1f54b-a351-4c5f-b55a-80b7cecee9e2 admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:37:49.133590 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-6dd1f54b-a351-4c5f-b55a-80b7cecee9e2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 May 12 11:37:49.134970 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 17/33] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 12 11:37:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:37:49.198954 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-371964e8-fa36-42c5-b147-4979b346e924 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "disk": 160, "id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true}} {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:37:49.218492 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-371964e8-fa36-42c5-b147-4979b346e924 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077820 May 12 11:37:49.219047 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 17/34] 10.222.0.58 () {64 vars in 1282 bytes} [Thu May 12 11:37:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 11:37:49.235391 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-971b8327-f7a1-4b46-a15a-8cc10bb65f80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:37:49.259616 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-971b8327-f7a1-4b46-a15a-8cc10bb65f80 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028404 May 12 11:37:49.260291 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 18/35] 10.222.0.58 () {64 vars in 1332 bytes} [Thu May 12 11:37:49 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:38:13.423585 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-371964e8-fa36-42c5-b147-4979b346e924 admin admin] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:38:13.424620 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-371964e8-fa36-42c5-b147-4979b346e924 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 May 12 11:38:13.425009 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 18/36] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 12 11:38:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:38:13.481902 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-ff0713ac-8b9f-46f7-a863-e6c55fa80421 admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:38:13.498345 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-ff0713ac-8b9f-46f7-a863-e6c55fa80421 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067590 May 12 11:38:13.498884 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 19/37] 10.222.0.58 () {60 vars in 1291 bytes} [Thu May 12 11:38:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:38:14.490798 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-371964e8-fa36-42c5-b147-4979b346e924 admin admin] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:38:14.491806 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-371964e8-fa36-42c5-b147-4979b346e924 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 12 11:38:14.492205 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 19/38] 10.222.0.58 () {56 vars in 1074 bytes} [Thu May 12 11:38:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:38:14.689066 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-7ee6d20c-6a98-49d8-a838-d0e4a8af9171 admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:38:14.694611 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.wsgi [None req-7ee6d20c-6a98-49d8-a838-d0e4a8af9171 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 11:38:14.698124 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-7ee6d20c-6a98-49d8-a838-d0e4a8af9171 admin admin] Request method failure captured: May 12 11:38:14.698124 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 12 11:38:14.698124 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: Accept: application/json May 12 11:38:14.698124 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: Accept-Encoding: gzip, deflate May 12 11:38:14.698124 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: Connection: keep-alive May 12 11:38:14.698124 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: Content-Length: 0 May 12 11:38:14.698124 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: Host: 10.222.0.58 May 12 11:38:14.698124 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: Openstack-Api-Version: compute 2.90 May 12 11:38:14.698124 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: Openstack-System-Scope: None May 12 11:38:14.698124 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: User-Agent: python-novaclient May 12 11:38:14.698124 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Auth-Token: gAAAAABifPGm28lMVsrbSGfziattQ4TidFb8xk5qbcMk7rX_S4RVKbvW5ECxU3WEuxqIUC2XjDNHv7ehdEZEW7-6r39MyntGKT-c626XPRfl8jw_38MH5qxKcgodwLrlQWU0xXAEklUdEIv-x8R-WnJJFOam9mJo3s72ZDY5FbXISFMXvrozJUA May 12 11:38:14.698124 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Domain-Id: None May 12 11:38:14.698124 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Domain-Name: None May 12 11:38:14.698124 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Identity-Status: Confirmed May 12 11:38:14.698124 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Is-Admin-Project: True May 12 11:38:14.698124 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Openstack-Nova-Api-Version: 2.90 May 12 11:38:14.698124 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Project-Domain-Id: default May 12 11:38:14.698124 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Project-Domain-Name: Default May 12 11:38:14.698124 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Project-Id: 11860b8464634d7683ecba74bb161400 May 12 11:38:14.698124 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Project-Name: admin May 12 11:38:14.698124 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Role: admin,member,reader May 12 11:38:14.698124 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Roles: admin,member,reader May 12 11:38:14.699929 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11860b8464634d7683ecba74bb161400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11860b8464634d7683ecba74bb161400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/11860b8464634d7683ecba74bb161400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_11860b8464634d7683ecba74bb161400", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:38:14.699929 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Tenant: admin May 12 11:38:14.699929 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Tenant-Id: 11860b8464634d7683ecba74bb161400 May 12 11:38:14.699929 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Tenant-Name: admin May 12 11:38:14.699929 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-User: admin May 12 11:38:14.699929 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-User-Domain-Id: default May 12 11:38:14.699929 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-User-Domain-Name: Default May 12 11:38:14.699929 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-User-Id: 9c5320af9c1c4a2f890e539109dfa042 May 12 11:38:14.699929 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-User-Name: admin May 12 11:38:14.699929 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: method: > May 12 11:38:14.699929 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: exception: Flavor 42 could not be found. May 12 11:38:14.699929 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: action_args: {'id': '42'} May 12 11:38:14.699929 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:38:14.699929 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:38:14.700873 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 11:38:14.700873 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 11:38:14.700873 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 11:38:14.700873 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 11:38:14.700873 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 11:38:14.700873 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 11:38:14.700873 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 11:38:14.700873 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 11:38:14.700873 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 11:38:14.700873 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:38:14.700873 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 11:38:14.700873 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 11:38:14.700873 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 12 11:38:14.700873 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi May 12 11:38:14.700873 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:38:14.700873 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi May 12 11:38:14.700873 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:38:14.700873 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:38:14.700873 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:38:14.702155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:38:14.702155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:38:14.702155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:38:14.702155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:38:14.702155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 11:38:14.702155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 11:38:14.702155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 12 11:38:14.702155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi May 12 11:38:14.702155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:38:14.702155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi May 12 11:38:14.702155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:38:14.702155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:38:14.702155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:38:14.702155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:38:14.702155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:38:14.702155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 12 11:38:14.702155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi May 12 11:38:14.702155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-7ee6d20c-6a98-49d8-a838-d0e4a8af9171 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:38:14.703262 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-7ee6d20c-6a98-49d8-a838-d0e4a8af9171 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060168 May 12 11:38:14.703262 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 20/39] 10.222.0.58 () {60 vars in 1190 bytes} [Thu May 12 11:38:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 11:38:14.709268 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-2face8e5-b2f2-4c2e-b484-4e321cd42919 admin admin] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:38:14.731673 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-2face8e5-b2f2-4c2e-b484-4e321cd42919 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026006 May 12 11:38:14.732216 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 20/40] 10.222.0.58 () {60 vars in 1210 bytes} [Thu May 12 11:38:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:38:14.742596 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-291d3c47-6c73-437a-9d6c-b993351f5d2e admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:38:14.763476 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-291d3c47-6c73-437a-9d6c-b993351f5d2e admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024441 May 12 11:38:14.763998 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 21/41] 10.222.0.58 () {60 vars in 1210 bytes} [Thu May 12 11:38:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:38:14.773431 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-c77da82c-bec4-4131-9338-d127a00cc3f0 admin admin] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:38:14.778923 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.wsgi [None req-c77da82c-bec4-4131-9338-d127a00cc3f0 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 11:38:14.782164 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-c77da82c-bec4-4131-9338-d127a00cc3f0 admin admin] Request method failure captured: May 12 11:38:14.782164 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 12 11:38:14.782164 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: Accept: application/json May 12 11:38:14.782164 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: Accept-Encoding: gzip, deflate May 12 11:38:14.782164 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: Connection: keep-alive May 12 11:38:14.782164 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: Content-Length: 0 May 12 11:38:14.782164 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: Host: 10.222.0.58 May 12 11:38:14.782164 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: Openstack-Api-Version: compute 2.90 May 12 11:38:14.782164 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: Openstack-System-Scope: None May 12 11:38:14.782164 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: User-Agent: python-novaclient May 12 11:38:14.782164 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Auth-Token: gAAAAABifPGm28lMVsrbSGfziattQ4TidFb8xk5qbcMk7rX_S4RVKbvW5ECxU3WEuxqIUC2XjDNHv7ehdEZEW7-6r39MyntGKT-c626XPRfl8jw_38MH5qxKcgodwLrlQWU0xXAEklUdEIv-x8R-WnJJFOam9mJo3s72ZDY5FbXISFMXvrozJUA May 12 11:38:14.782164 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Domain-Id: None May 12 11:38:14.782164 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Domain-Name: None May 12 11:38:14.782164 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Identity-Status: Confirmed May 12 11:38:14.782164 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Is-Admin-Project: True May 12 11:38:14.782164 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Openstack-Nova-Api-Version: 2.90 May 12 11:38:14.782164 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Project-Domain-Id: default May 12 11:38:14.782164 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Project-Domain-Name: Default May 12 11:38:14.782164 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Project-Id: 11860b8464634d7683ecba74bb161400 May 12 11:38:14.782164 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Project-Name: admin May 12 11:38:14.782164 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Role: admin,member,reader May 12 11:38:14.782164 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Roles: admin,member,reader May 12 11:38:14.784247 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11860b8464634d7683ecba74bb161400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11860b8464634d7683ecba74bb161400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/11860b8464634d7683ecba74bb161400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_11860b8464634d7683ecba74bb161400", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:38:14.784247 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Tenant: admin May 12 11:38:14.784247 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Tenant-Id: 11860b8464634d7683ecba74bb161400 May 12 11:38:14.784247 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Tenant-Name: admin May 12 11:38:14.784247 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-User: admin May 12 11:38:14.784247 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-User-Domain-Id: default May 12 11:38:14.784247 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-User-Domain-Name: Default May 12 11:38:14.784247 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-User-Id: 9c5320af9c1c4a2f890e539109dfa042 May 12 11:38:14.784247 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-User-Name: admin May 12 11:38:14.784247 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: method: > May 12 11:38:14.784247 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: exception: Flavor 42 could not be found. May 12 11:38:14.784247 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: action_args: {'id': '42'} May 12 11:38:14.784247 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:38:14.784247 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:38:14.785364 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 11:38:14.785364 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 11:38:14.785364 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 11:38:14.785364 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 11:38:14.785364 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 11:38:14.785364 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 11:38:14.785364 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 11:38:14.785364 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 11:38:14.785364 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 11:38:14.785364 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:38:14.785364 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 11:38:14.785364 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 11:38:14.785364 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 12 11:38:14.785364 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi May 12 11:38:14.785364 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:38:14.785364 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi May 12 11:38:14.785364 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:38:14.785364 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:38:14.785364 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:38:14.786697 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:38:14.786697 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:38:14.786697 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:38:14.786697 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:38:14.786697 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 11:38:14.786697 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 11:38:14.786697 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 12 11:38:14.786697 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi May 12 11:38:14.786697 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:38:14.786697 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi May 12 11:38:14.786697 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:38:14.786697 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:38:14.786697 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:38:14.786697 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:38:14.786697 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:38:14.786697 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 12 11:38:14.786697 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi May 12 11:38:14.786697 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-c77da82c-bec4-4131-9338-d127a00cc3f0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:38:14.787923 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-c77da82c-bec4-4131-9338-d127a00cc3f0 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013969 May 12 11:38:14.787923 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 21/42] 10.222.0.58 () {60 vars in 1190 bytes} [Thu May 12 11:38:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 12 11:38:15.657760 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-291d3c47-6c73-437a-9d6c-b993351f5d2e admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:38:15.658868 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-291d3c47-6c73-437a-9d6c-b993351f5d2e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 12 11:38:15.659297 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 22/43] 10.222.0.58 () {56 vars in 1074 bytes} [Thu May 12 11:38:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:38:15.849686 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-4eef6e88-82b6-402d-8651-638abcb871c5 admin admin] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:38:15.855000 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.wsgi [None req-4eef6e88-82b6-402d-8651-638abcb871c5 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 11:38:15.856496 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-4eef6e88-82b6-402d-8651-638abcb871c5 admin admin] Request method failure captured: May 12 11:38:15.856496 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 12 11:38:15.856496 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: Accept: application/json May 12 11:38:15.856496 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: Accept-Encoding: gzip, deflate May 12 11:38:15.856496 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: Connection: keep-alive May 12 11:38:15.856496 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: Content-Length: 0 May 12 11:38:15.856496 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: Host: 10.222.0.58 May 12 11:38:15.856496 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: Openstack-Api-Version: compute 2.90 May 12 11:38:15.856496 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: Openstack-System-Scope: None May 12 11:38:15.856496 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: User-Agent: python-novaclient May 12 11:38:15.856496 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Auth-Token: gAAAAABifPGnQC5aMiZ5JFA8EqdXEcttndGjFHyKRaoHV6-TO_fu3VIeLy68cQIKgtj42r9BrSbIw-1m5_H84frsrDcQJH_pRkmyqgceXRRTdUIzONjaNNwRaUEmnK2aE6EtOQ7u3CkM8QN2zi--FqdLcvA6eZkpc0wTq8iYV-CRswzfVPz9JTg May 12 11:38:15.856496 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Domain-Id: None May 12 11:38:15.856496 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Domain-Name: None May 12 11:38:15.856496 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Identity-Status: Confirmed May 12 11:38:15.856496 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Is-Admin-Project: True May 12 11:38:15.856496 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Openstack-Nova-Api-Version: 2.90 May 12 11:38:15.856496 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Project-Domain-Id: default May 12 11:38:15.856496 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Project-Domain-Name: Default May 12 11:38:15.856496 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Project-Id: 11860b8464634d7683ecba74bb161400 May 12 11:38:15.856496 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Project-Name: admin May 12 11:38:15.856496 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Role: admin,member,reader May 12 11:38:15.856496 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Roles: admin,member,reader May 12 11:38:15.857818 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11860b8464634d7683ecba74bb161400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11860b8464634d7683ecba74bb161400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/11860b8464634d7683ecba74bb161400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_11860b8464634d7683ecba74bb161400", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:38:15.857818 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Tenant: admin May 12 11:38:15.857818 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Tenant-Id: 11860b8464634d7683ecba74bb161400 May 12 11:38:15.857818 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Tenant-Name: admin May 12 11:38:15.857818 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-User: admin May 12 11:38:15.857818 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-User-Domain-Id: default May 12 11:38:15.857818 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-User-Domain-Name: Default May 12 11:38:15.857818 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-User-Id: 9c5320af9c1c4a2f890e539109dfa042 May 12 11:38:15.857818 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-User-Name: admin May 12 11:38:15.857818 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: method: > May 12 11:38:15.857818 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: exception: Flavor 84 could not be found. May 12 11:38:15.857818 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: action_args: {'id': '84'} May 12 11:38:15.857818 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:38:15.857818 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:38:15.858652 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 11:38:15.858652 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 11:38:15.858652 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 11:38:15.858652 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 11:38:15.858652 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 11:38:15.858652 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 11:38:15.858652 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 11:38:15.858652 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 11:38:15.858652 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 11:38:15.858652 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:38:15.858652 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 11:38:15.858652 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 11:38:15.858652 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 12 11:38:15.858652 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi May 12 11:38:15.858652 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:38:15.858652 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi May 12 11:38:15.858652 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:38:15.858652 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:38:15.858652 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:38:15.859704 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:38:15.859704 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:38:15.859704 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:38:15.859704 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:38:15.859704 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 11:38:15.859704 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 11:38:15.859704 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 12 11:38:15.859704 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi May 12 11:38:15.859704 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:38:15.859704 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi May 12 11:38:15.859704 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:38:15.859704 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:38:15.859704 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:38:15.859704 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:38:15.859704 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:38:15.859704 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 12 11:38:15.859704 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi May 12 11:38:15.859704 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-4eef6e88-82b6-402d-8651-638abcb871c5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:38:15.860767 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-4eef6e88-82b6-402d-8651-638abcb871c5 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.066207 May 12 11:38:15.860767 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 22/44] 10.222.0.58 () {60 vars in 1190 bytes} [Thu May 12 11:38:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 12 11:38:15.868493 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-3ffc3ed6-d59c-4724-99a9-5dda97563c38 admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:38:15.882451 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-3ffc3ed6-d59c-4724-99a9-5dda97563c38 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017601 May 12 11:38:15.882978 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 23/45] 10.222.0.58 () {60 vars in 1210 bytes} [Thu May 12 11:38:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:38:15.892244 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-10b937ad-361e-41c0-81e7-0de03a91dc0f admin admin] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:38:15.905685 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-10b937ad-361e-41c0-81e7-0de03a91dc0f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016926 May 12 11:38:15.906227 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 23/46] 10.222.0.58 () {60 vars in 1210 bytes} [Thu May 12 11:38:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:38:15.915098 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-496b3216-5ff2-49b6-a82c-f02556763edb admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:38:15.920223 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.wsgi [None req-496b3216-5ff2-49b6-a82c-f02556763edb admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 11:38:15.921740 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-496b3216-5ff2-49b6-a82c-f02556763edb admin admin] Request method failure captured: May 12 11:38:15.921740 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 12 11:38:15.921740 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: Accept: application/json May 12 11:38:15.921740 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: Accept-Encoding: gzip, deflate May 12 11:38:15.921740 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: Connection: keep-alive May 12 11:38:15.921740 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: Content-Length: 0 May 12 11:38:15.921740 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: Host: 10.222.0.58 May 12 11:38:15.921740 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: Openstack-Api-Version: compute 2.90 May 12 11:38:15.921740 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: Openstack-System-Scope: None May 12 11:38:15.921740 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: User-Agent: python-novaclient May 12 11:38:15.921740 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Auth-Token: gAAAAABifPGnQC5aMiZ5JFA8EqdXEcttndGjFHyKRaoHV6-TO_fu3VIeLy68cQIKgtj42r9BrSbIw-1m5_H84frsrDcQJH_pRkmyqgceXRRTdUIzONjaNNwRaUEmnK2aE6EtOQ7u3CkM8QN2zi--FqdLcvA6eZkpc0wTq8iYV-CRswzfVPz9JTg May 12 11:38:15.921740 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Domain-Id: None May 12 11:38:15.921740 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Domain-Name: None May 12 11:38:15.921740 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Identity-Status: Confirmed May 12 11:38:15.921740 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Is-Admin-Project: True May 12 11:38:15.921740 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Openstack-Nova-Api-Version: 2.90 May 12 11:38:15.921740 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Project-Domain-Id: default May 12 11:38:15.921740 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Project-Domain-Name: Default May 12 11:38:15.921740 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Project-Id: 11860b8464634d7683ecba74bb161400 May 12 11:38:15.921740 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Project-Name: admin May 12 11:38:15.921740 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Role: admin,member,reader May 12 11:38:15.921740 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Roles: admin,member,reader May 12 11:38:15.923295 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11860b8464634d7683ecba74bb161400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11860b8464634d7683ecba74bb161400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/11860b8464634d7683ecba74bb161400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_11860b8464634d7683ecba74bb161400", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:38:15.923295 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Tenant: admin May 12 11:38:15.923295 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Tenant-Id: 11860b8464634d7683ecba74bb161400 May 12 11:38:15.923295 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Tenant-Name: admin May 12 11:38:15.923295 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-User: admin May 12 11:38:15.923295 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-User-Domain-Id: default May 12 11:38:15.923295 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-User-Domain-Name: Default May 12 11:38:15.923295 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-User-Id: 9c5320af9c1c4a2f890e539109dfa042 May 12 11:38:15.923295 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-User-Name: admin May 12 11:38:15.923295 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: method: > May 12 11:38:15.923295 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: exception: Flavor 84 could not be found. May 12 11:38:15.923295 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: action_args: {'id': '84'} May 12 11:38:15.923295 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:38:15.923295 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:38:15.924155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 11:38:15.924155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 11:38:15.924155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 11:38:15.924155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 11:38:15.924155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 11:38:15.924155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 11:38:15.924155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 11:38:15.924155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 11:38:15.924155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 11:38:15.924155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:38:15.924155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 11:38:15.924155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 11:38:15.924155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 12 11:38:15.924155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi May 12 11:38:15.924155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:38:15.924155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi May 12 11:38:15.924155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:38:15.924155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:38:15.924155 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:38:15.925864 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:38:15.925864 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:38:15.925864 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:38:15.925864 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:38:15.925864 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 11:38:15.925864 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 11:38:15.925864 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 12 11:38:15.925864 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi May 12 11:38:15.925864 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:38:15.925864 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi May 12 11:38:15.925864 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:38:15.925864 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:38:15.925864 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:38:15.925864 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:38:15.925864 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:38:15.925864 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 12 11:38:15.925864 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi May 12 11:38:15.925864 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-496b3216-5ff2-49b6-a82c-f02556763edb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:38:15.926894 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-496b3216-5ff2-49b6-a82c-f02556763edb admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011402 May 12 11:38:15.926894 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 24/47] 10.222.0.58 () {60 vars in 1190 bytes} [Thu May 12 11:38:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 11:38:16.816593 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-10b937ad-361e-41c0-81e7-0de03a91dc0f admin admin] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:38:16.817634 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-10b937ad-361e-41c0-81e7-0de03a91dc0f admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 12 11:38:16.818074 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 24/48] 10.222.0.58 () {56 vars in 1074 bytes} [Thu May 12 11:38:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:38:17.004793 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-c1254fca-d055-4668-8f36-9356d94f59dd admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:38:17.010385 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.wsgi [None req-c1254fca-d055-4668-8f36-9356d94f59dd admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 11:38:17.011885 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-c1254fca-d055-4668-8f36-9356d94f59dd admin admin] Request method failure captured: May 12 11:38:17.011885 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 12 11:38:17.011885 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: Accept: application/json May 12 11:38:17.011885 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: Accept-Encoding: gzip, deflate May 12 11:38:17.011885 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: Connection: keep-alive May 12 11:38:17.011885 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: Content-Length: 0 May 12 11:38:17.011885 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: Host: 10.222.0.58 May 12 11:38:17.011885 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: Openstack-Api-Version: compute 2.90 May 12 11:38:17.011885 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: Openstack-System-Scope: None May 12 11:38:17.011885 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: User-Agent: python-novaclient May 12 11:38:17.011885 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Auth-Token: gAAAAABifPGociWiczX8aNmNqh-rqHZJ3ZQX4DofE351OhFtnHePKcQ2p70rGGYLlMlLR6Se20DjCuUEB84UoswCRdUos9AWvxZGDKYjRZI5nuwd8ORCHlr0vqSXNnOzPbcotD_17iGGPyrwQOzJGy6xHwDs17Cu113h-CHAeeL1P0Ay6q58yLU May 12 11:38:17.011885 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Domain-Id: None May 12 11:38:17.011885 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Domain-Name: None May 12 11:38:17.011885 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Identity-Status: Confirmed May 12 11:38:17.011885 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Is-Admin-Project: True May 12 11:38:17.011885 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Openstack-Nova-Api-Version: 2.90 May 12 11:38:17.011885 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Project-Domain-Id: default May 12 11:38:17.011885 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Project-Domain-Name: Default May 12 11:38:17.011885 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Project-Id: 11860b8464634d7683ecba74bb161400 May 12 11:38:17.011885 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Project-Name: admin May 12 11:38:17.011885 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Role: admin,member,reader May 12 11:38:17.011885 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Roles: admin,member,reader May 12 11:38:17.013219 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11860b8464634d7683ecba74bb161400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11860b8464634d7683ecba74bb161400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/11860b8464634d7683ecba74bb161400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_11860b8464634d7683ecba74bb161400", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:38:17.013219 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Tenant: admin May 12 11:38:17.013219 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Tenant-Id: 11860b8464634d7683ecba74bb161400 May 12 11:38:17.013219 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-Tenant-Name: admin May 12 11:38:17.013219 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-User: admin May 12 11:38:17.013219 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-User-Domain-Id: default May 12 11:38:17.013219 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-User-Domain-Name: Default May 12 11:38:17.013219 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-User-Id: 9c5320af9c1c4a2f890e539109dfa042 May 12 11:38:17.013219 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: X-User-Name: admin May 12 11:38:17.013219 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: method: > May 12 11:38:17.013219 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: exception: Flavor 451 could not be found. May 12 11:38:17.013219 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: action_args: {'id': '451'} May 12 11:38:17.013219 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:38:17.013219 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:38:17.014084 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 11:38:17.014084 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 11:38:17.014084 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 11:38:17.014084 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 11:38:17.014084 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 11:38:17.014084 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 11:38:17.014084 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 11:38:17.014084 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 11:38:17.014084 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 11:38:17.014084 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:38:17.014084 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 11:38:17.014084 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 11:38:17.014084 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 12 11:38:17.014084 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi May 12 11:38:17.014084 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:38:17.014084 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi May 12 11:38:17.014084 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:38:17.014084 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:38:17.014084 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:38:17.015455 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:38:17.015455 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:38:17.015455 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:38:17.015455 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:38:17.015455 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 11:38:17.015455 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 11:38:17.015455 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 12 11:38:17.015455 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi May 12 11:38:17.015455 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:38:17.015455 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi May 12 11:38:17.015455 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:38:17.015455 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:38:17.015455 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:38:17.015455 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:38:17.015455 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:38:17.015455 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 12 11:38:17.015455 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: ERROR nova.api.openstack.wsgi May 12 11:38:17.015455 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-c1254fca-d055-4668-8f36-9356d94f59dd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:38:17.016707 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-c1254fca-d055-4668-8f36-9356d94f59dd admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058795 May 12 11:38:17.016707 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 25/49] 10.222.0.58 () {60 vars in 1193 bytes} [Thu May 12 11:38:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 11:38:17.022873 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-b5388658-ccea-4895-babe-9467ed072b36 admin admin] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:38:17.036863 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-b5388658-ccea-4895-babe-9467ed072b36 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017486 May 12 11:38:17.037321 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 25/50] 10.222.0.58 () {60 vars in 1210 bytes} [Thu May 12 11:38:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:38:17.046251 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-8b14187b-d2d0-4434-9bc1-a5da3b73ad10 admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:38:17.060172 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-8b14187b-d2d0-4434-9bc1-a5da3b73ad10 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017336 May 12 11:38:17.060690 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 26/51] 10.222.0.58 () {60 vars in 1210 bytes} [Thu May 12 11:38:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:38:17.069617 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-a1b5dcb8-6da1-4976-b0ec-b2468d2e4397 admin admin] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:38:17.075008 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.wsgi [None req-a1b5dcb8-6da1-4976-b0ec-b2468d2e4397 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 11:38:17.076512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-a1b5dcb8-6da1-4976-b0ec-b2468d2e4397 admin admin] Request method failure captured: May 12 11:38:17.076512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 12 11:38:17.076512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: Accept: application/json May 12 11:38:17.076512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: Accept-Encoding: gzip, deflate May 12 11:38:17.076512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: Connection: keep-alive May 12 11:38:17.076512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: Content-Length: 0 May 12 11:38:17.076512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: Host: 10.222.0.58 May 12 11:38:17.076512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: Openstack-Api-Version: compute 2.90 May 12 11:38:17.076512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: Openstack-System-Scope: None May 12 11:38:17.076512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: User-Agent: python-novaclient May 12 11:38:17.076512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Auth-Token: gAAAAABifPGociWiczX8aNmNqh-rqHZJ3ZQX4DofE351OhFtnHePKcQ2p70rGGYLlMlLR6Se20DjCuUEB84UoswCRdUos9AWvxZGDKYjRZI5nuwd8ORCHlr0vqSXNnOzPbcotD_17iGGPyrwQOzJGy6xHwDs17Cu113h-CHAeeL1P0Ay6q58yLU May 12 11:38:17.076512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Domain-Id: None May 12 11:38:17.076512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Domain-Name: None May 12 11:38:17.076512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Identity-Status: Confirmed May 12 11:38:17.076512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Is-Admin-Project: True May 12 11:38:17.076512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Openstack-Nova-Api-Version: 2.90 May 12 11:38:17.076512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Project-Domain-Id: default May 12 11:38:17.076512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Project-Domain-Name: Default May 12 11:38:17.076512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Project-Id: 11860b8464634d7683ecba74bb161400 May 12 11:38:17.076512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Project-Name: admin May 12 11:38:17.076512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Role: admin,member,reader May 12 11:38:17.076512 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Roles: admin,member,reader May 12 11:38:17.078153 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11860b8464634d7683ecba74bb161400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11860b8464634d7683ecba74bb161400"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/11860b8464634d7683ecba74bb161400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_11860b8464634d7683ecba74bb161400", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:38:17.078153 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Tenant: admin May 12 11:38:17.078153 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Tenant-Id: 11860b8464634d7683ecba74bb161400 May 12 11:38:17.078153 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-Tenant-Name: admin May 12 11:38:17.078153 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-User: admin May 12 11:38:17.078153 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-User-Domain-Id: default May 12 11:38:17.078153 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-User-Domain-Name: Default May 12 11:38:17.078153 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-User-Id: 9c5320af9c1c4a2f890e539109dfa042 May 12 11:38:17.078153 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: X-User-Name: admin May 12 11:38:17.078153 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: method: > May 12 11:38:17.078153 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: exception: Flavor 451 could not be found. May 12 11:38:17.078153 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: action_args: {'id': '451'} May 12 11:38:17.078153 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:38:17.078153 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:38:17.079154 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 11:38:17.079154 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 11:38:17.079154 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 11:38:17.079154 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 11:38:17.079154 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 11:38:17.079154 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 11:38:17.079154 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 11:38:17.079154 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 11:38:17.079154 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 11:38:17.079154 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:38:17.079154 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 11:38:17.079154 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 11:38:17.079154 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 12 11:38:17.079154 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi May 12 11:38:17.079154 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:38:17.079154 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi May 12 11:38:17.079154 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:38:17.079154 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:38:17.079154 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:38:17.080468 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:38:17.080468 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:38:17.080468 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:38:17.080468 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:38:17.080468 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 11:38:17.080468 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 11:38:17.080468 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 12 11:38:17.080468 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi May 12 11:38:17.080468 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:38:17.080468 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi May 12 11:38:17.080468 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:38:17.080468 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:38:17.080468 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:38:17.080468 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:38:17.080468 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:38:17.080468 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 12 11:38:17.080468 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: ERROR nova.api.openstack.wsgi May 12 11:38:17.080468 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-a1b5dcb8-6da1-4976-b0ec-b2468d2e4397 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:38:17.081795 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-a1b5dcb8-6da1-4976-b0ec-b2468d2e4397 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011625 May 12 11:38:17.081795 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 26/52] 10.222.0.58 () {60 vars in 1193 bytes} [Thu May 12 11:38:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 12 11:38:17.958437 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-8b14187b-d2d0-4434-9bc1-a5da3b73ad10 admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:38:17.959435 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-8b14187b-d2d0-4434-9bc1-a5da3b73ad10 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 12 11:38:17.959836 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 27/53] 10.222.0.58 () {56 vars in 1074 bytes} [Thu May 12 11:38:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:38:18.146473 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-655ba99d-1db8-4c4e-8568-772551ce0d3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:38:18.163450 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-655ba99d-1db8-4c4e-8568-772551ce0d3f admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068018 May 12 11:38:18.163980 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 27/54] 10.222.0.58 () {64 vars in 1235 bytes} [Thu May 12 11:38:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 11:38:19.042700 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-8b14187b-d2d0-4434-9bc1-a5da3b73ad10 admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:38:19.043710 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-8b14187b-d2d0-4434-9bc1-a5da3b73ad10 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 May 12 11:38:19.044108 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 28/55] 10.222.0.58 () {56 vars in 1074 bytes} [Thu May 12 11:38:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:38:19.235116 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-652c375a-7ff8-49eb-9952-7fe6dc56b0a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:38:19.252349 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-652c375a-7ff8-49eb-9952-7fe6dc56b0a9 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.071335 May 12 11:38:19.252825 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 28/56] 10.222.0.58 () {64 vars in 1235 bytes} [Thu May 12 11:38:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 11:38:20.133466 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-8b14187b-d2d0-4434-9bc1-a5da3b73ad10 admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:38:20.134499 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-8b14187b-d2d0-4434-9bc1-a5da3b73ad10 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 12 11:38:20.134898 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 29/57] 10.222.0.58 () {56 vars in 1074 bytes} [Thu May 12 11:38:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:38:20.321427 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-4ef643ce-20ff-473b-9c07-4bc35b37385d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:38:20.339701 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-4ef643ce-20ff-473b-9c07-4bc35b37385d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068643 May 12 11:38:20.340248 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 29/58] 10.222.0.58 () {64 vars in 1235 bytes} [Thu May 12 11:38:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 11:38:21.220090 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-8b14187b-d2d0-4434-9bc1-a5da3b73ad10 admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:38:21.221118 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-8b14187b-d2d0-4434-9bc1-a5da3b73ad10 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 12 11:38:21.221509 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 30/59] 10.222.0.58 () {56 vars in 1074 bytes} [Thu May 12 11:38:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:38:21.410796 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-cb30b33e-fee7-452b-9395-f490eabf3784 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:38:21.428362 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-cb30b33e-fee7-452b-9395-f490eabf3784 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071450 May 12 11:38:21.428887 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 30/60] 10.222.0.58 () {64 vars in 1235 bytes} [Thu May 12 11:38:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 11:38:22.314185 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-8b14187b-d2d0-4434-9bc1-a5da3b73ad10 admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:38:22.315189 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-8b14187b-d2d0-4434-9bc1-a5da3b73ad10 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 12 11:38:22.315590 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 31/61] 10.222.0.58 () {56 vars in 1074 bytes} [Thu May 12 11:38:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:38:22.507635 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-aa0c18dc-a558-4601-8bd0-2a0b1e249283 admin admin] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:38:22.527011 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-aa0c18dc-a558-4601-8bd0-2a0b1e249283 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.076357 May 12 11:38:22.527490 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 31/62] 10.222.0.58 () {60 vars in 1202 bytes} [Thu May 12 11:38:22 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:39:24.357128 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-8b14187b-d2d0-4434-9bc1-a5da3b73ad10 admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:39:24.358160 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-8b14187b-d2d0-4434-9bc1-a5da3b73ad10 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 12 11:39:24.358552 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 32/63] 10.222.0.58 () {54 vars in 930 bytes} [Thu May 12 11:39:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:39:24.415387 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-c80e43cb-e6af-43f2-896f-b008630a9499 admin admin] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:39:24.434258 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-c80e43cb-e6af-43f2-896f-b008630a9499 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069932 May 12 11:39:24.434792 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 32/64] 10.222.0.58 () {60 vars in 1291 bytes} [Thu May 12 11:39:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:39:24.457574 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-20b176ff-9f9d-4663-8597-8627b6eb781a admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:39:24.465953 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-20b176ff-9f9d-4663-8597-8627b6eb781a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012568 May 12 11:39:24.466470 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 33/65] 10.222.0.58 () {60 vars in 1282 bytes} [Thu May 12 11:39:24 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:39:24.477540 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-b70d9abd-ac7f-4d5a-b62b-f716dab1fb83 admin admin] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:39:24.484929 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-b70d9abd-ac7f-4d5a-b62b-f716dab1fb83 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010927 May 12 11:39:24.485437 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 33/66] 10.222.0.58 () {60 vars in 1285 bytes} [Thu May 12 11:39:24 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:39:24.495991 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-a2d75bc7-77ff-4143-ae7e-7fc09a72f077 admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:39:24.503577 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-a2d75bc7-77ff-4143-ae7e-7fc09a72f077 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010950 May 12 11:39:24.504110 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 34/67] 10.222.0.58 () {60 vars in 1285 bytes} [Thu May 12 11:39:24 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:39:24.515836 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-91f10ed5-6b41-4acc-be09-a18a57de1264 admin admin] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:39:24.523785 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-91f10ed5-6b41-4acc-be09-a18a57de1264 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011513 May 12 11:39:24.524288 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 34/68] 10.222.0.58 () {60 vars in 1282 bytes} [Thu May 12 11:39:24 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:42:51.436810 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-a2d75bc7-77ff-4143-ae7e-7fc09a72f077 admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:42:51.437843 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-a2d75bc7-77ff-4143-ae7e-7fc09a72f077 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 12 11:42:51.438243 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 35/69] 10.222.0.58 () {56 vars in 1074 bytes} [Thu May 12 11:42:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:42:51.713394 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-2fd882de-c5e2-4138-8bef-3016776f53a4 admin admin] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:42:51.714591 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 11:42:51.714591 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: warnings.warn(msg) May 12 11:42:51.715834 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_concurrency.lockutils [None req-2fd882de-c5e2-4138-8bef-3016776f53a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:42:51.716920 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_concurrency.lockutils [None req-2fd882de-c5e2-4138-8bef-3016776f53a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:42:51.717686 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_concurrency.lockutils [None req-2fd882de-c5e2-4138-8bef-3016776f53a4 admin admin] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:42:51.718133 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_concurrency.lockutils [None req-2fd882de-c5e2-4138-8bef-3016776f53a4 admin admin] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:42:51.750725 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-2fd882de-c5e2-4138-8bef-3016776f53a4 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.146902 May 12 11:42:51.751266 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 35/70] 10.222.0.58 () {60 vars in 1193 bytes} [Thu May 12 11:42:51 2022] GET /compute/v2.1/os-services => generated 794 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 11:42:52.637082 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-a2d75bc7-77ff-4143-ae7e-7fc09a72f077 admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:42:52.638667 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-a2d75bc7-77ff-4143-ae7e-7fc09a72f077 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 May 12 11:42:52.639060 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 36/71] 10.222.0.58 () {56 vars in 1074 bytes} [Thu May 12 11:42:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:42:52.827586 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-0a6ad001-6f0b-4d84-ab31-382fb70682b4 admin admin] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:42:52.828809 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 11:42:52.828809 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: warnings.warn(msg) May 12 11:42:52.829998 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_concurrency.lockutils [None req-0a6ad001-6f0b-4d84-ab31-382fb70682b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:42:52.830461 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_concurrency.lockutils [None req-0a6ad001-6f0b-4d84-ab31-382fb70682b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:42:52.831231 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_concurrency.lockutils [None req-0a6ad001-6f0b-4d84-ab31-382fb70682b4 admin admin] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:42:52.831652 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_concurrency.lockutils [None req-0a6ad001-6f0b-4d84-ab31-382fb70682b4 admin admin] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:42:52.850391 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-0a6ad001-6f0b-4d84-ab31-382fb70682b4 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.074231 May 12 11:42:52.850918 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 36/72] 10.222.0.58 () {60 vars in 1193 bytes} [Thu May 12 11:42:52 2022] GET /compute/v2.1/os-services => generated 794 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 11:43:04.166945 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-a2d75bc7-77ff-4143-ae7e-7fc09a72f077 admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:43:04.168559 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-a2d75bc7-77ff-4143-ae7e-7fc09a72f077 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 May 12 11:43:04.169092 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 37/73] 10.222.0.58 () {56 vars in 1074 bytes} [Thu May 12 11:43:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:43:04.359292 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-de531d0e-48c1-4b13-81cc-477cc8e575cf admin admin] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:43:04.360467 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 11:43:04.360467 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: warnings.warn(msg) May 12 11:43:04.361672 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_concurrency.lockutils [None req-de531d0e-48c1-4b13-81cc-477cc8e575cf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:43:04.362147 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_concurrency.lockutils [None req-de531d0e-48c1-4b13-81cc-477cc8e575cf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:43:04.362928 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_concurrency.lockutils [None req-de531d0e-48c1-4b13-81cc-477cc8e575cf admin admin] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:43:04.363357 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_concurrency.lockutils [None req-de531d0e-48c1-4b13-81cc-477cc8e575cf admin admin] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:43:04.387319 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-de531d0e-48c1-4b13-81cc-477cc8e575cf admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.078158 May 12 11:43:04.387858 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 37/74] 10.222.0.58 () {60 vars in 1193 bytes} [Thu May 12 11:43:04 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:43:05.289720 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: DEBUG nova.api.openstack.wsgi [None req-a2d75bc7-77ff-4143-ae7e-7fc09a72f077 admin admin] Calling method '>' {{(pid=109155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:43:05.290729 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: INFO nova.api.openstack.requestlog [None req-a2d75bc7-77ff-4143-ae7e-7fc09a72f077 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 May 12 11:43:05.291134 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: [pid: 109155|app: 0|req: 38/75] 10.222.0.58 () {56 vars in 1074 bytes} [Thu May 12 11:43:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:43:05.479503 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG nova.api.openstack.wsgi [None req-2c00d93f-d6e4-44e7-99b9-b7a4031bf0cd admin admin] Calling method '>' {{(pid=109156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:43:05.481201 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 11:43:05.481201 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: warnings.warn(msg) May 12 11:43:05.482420 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_concurrency.lockutils [None req-2c00d93f-d6e4-44e7-99b9-b7a4031bf0cd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:43:05.482852 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_concurrency.lockutils [None req-2c00d93f-d6e4-44e7-99b9-b7a4031bf0cd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:43:05.483620 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_concurrency.lockutils [None req-2c00d93f-d6e4-44e7-99b9-b7a4031bf0cd admin admin] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:43:05.484039 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: DEBUG oslo_concurrency.lockutils [None req-2c00d93f-d6e4-44e7-99b9-b7a4031bf0cd admin admin] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:43:05.508828 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: INFO nova.api.openstack.requestlog [None req-2c00d93f-d6e4-44e7-99b9-b7a4031bf0cd admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.080328 May 12 11:43:05.509388 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: [pid: 109156|app: 0|req: 38/76] 10.222.0.58 () {60 vars in 1193 bytes} [Thu May 12 11:43:05 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:44:05.627961 dv-cinder-804735-29-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 12 11:44:05.628893 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: Thu May 12 11:44:05 2022 - graceful shutdown triggered... May 12 11:44:05.629411 dv-cinder-804735-29-iscsi devstack@n-api.service[109155]: Gracefully killing worker 1 (pid: 109155)... May 12 11:44:05.629826 dv-cinder-804735-29-iscsi devstack@n-api.service[109156]: Gracefully killing worker 2 (pid: 109156)... May 12 11:44:06.629802 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: worker 1 buried after 1 seconds May 12 11:44:06.630858 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: worker 2 buried after 1 seconds May 12 11:44:06.630858 dv-cinder-804735-29-iscsi devstack@n-api.service[109154]: goodbye to uWSGI. May 12 11:44:06.631943 dv-cinder-804735-29-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 12 11:44:06.632509 dv-cinder-804735-29-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 12 11:44:06.635286 dv-cinder-804735-29-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 11:44:06.650534 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 11:44:06.679802 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 11:44:06 2022] *** May 12 11:44:06.679802 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 11:44:06.679802 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 11:44:06.679802 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: nodename: dv-cinder-804735-29-iscsi May 12 11:44:06.679802 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: machine: x86_64 May 12 11:44:06.679802 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: clock source: unix May 12 11:44:06.679802 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: pcre jit disabled May 12 11:44:06.679802 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: detected number of CPU cores: 4 May 12 11:44:06.679802 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: current working directory: / May 12 11:44:06.679802 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: detected binary path: /usr/bin/uwsgi-core May 12 11:44:06.679802 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: your processes number limit is 47680 May 12 11:44:06.679802 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: your memory page size is 4096 bytes May 12 11:44:06.679802 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: detected max file descriptor number: 2048 May 12 11:44:06.679802 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: lock engine: pthread robust mutexes May 12 11:44:06.680784 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: thunder lock: enabled May 12 11:44:06.680784 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 11:44:06.680784 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 11:44:06.728335 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: Python main interpreter initialized at 0x55f3b5a409c0 May 12 11:44:06.728335 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: python threads support enabled May 12 11:44:06.728335 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: your server socket listen backlog is limited to 100 connections May 12 11:44:06.728335 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: your mercy for graceful operations on workers is 90 seconds May 12 11:44:06.728776 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: mapped 403077 bytes (393 KB) for 2 cores May 12 11:44:06.728776 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: *** Operational MODE: preforking *** May 12 11:44:06.729011 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: *** uWSGI is running in multiple interpreter mode *** May 12 11:44:06.729011 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: spawned uWSGI master process (pid: 123485) May 12 11:44:06.729216 dv-cinder-804735-29-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 11:44:06.729963 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: spawned uWSGI worker 1 (pid: 123507, cores: 1) May 12 11:44:06.733090 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: spawned uWSGI worker 2 (pid: 123508, cores: 1) May 12 11:44:06.733090 dv-cinder-804735-29-iscsi devstack@n-api.service[123485]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 11:44:07.945287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 11:44:07.956056 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 11:44:08.758543 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 11:44:08.758543 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: from cryptography.utils import int_from_bytes May 12 11:44:08.758854 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 11:44:08.758854 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: from cryptography.utils import int_from_bytes May 12 11:44:08.759323 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 11:44:08.759323 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: from cryptography.utils import int_from_bytes May 12 11:44:08.759647 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 11:44:08.759647 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: from cryptography.utils import int_from_bytes May 12 11:44:11.180450 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 11:44:11.181008 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 11:44:11.181285 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 11:44:11.181614 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 11:44:11.181955 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 11:44:11.182365 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.182673 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.183196 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.183520 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.183858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.184172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.184497 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.184821 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.185152 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.185680 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.186022 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.186352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-29-iscsi {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.186679 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.186991 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.187304 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.187626 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.187932 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.188255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.188565 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.189070 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.190337 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.190337 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.190619 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.191087 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.191391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.191716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.192070 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.192386 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.192738 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.193047 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.193596 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-29-iscsi {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.193942 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.194263 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.194583 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.195012 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.195323 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.195652 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.195968 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.196295 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.196607 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.196941 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.197265 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.197604 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.197928 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.198249 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.198559 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.198874 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.199199 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.199506 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.199814 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.200067 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.200487 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.200814 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.201150 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.201465 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.201752 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.201993 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.202355 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.202726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.203180 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 11:44:11.203650 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 11:44:11.203977 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 11:44:11.204349 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 11:44:11.204612 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 11:44:11.205009 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.205345 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.205674 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.206287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.206638 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.206963 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.207294 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.207484 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.207636 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.207785 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.207977 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.208138 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.208296 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.208492 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.208662 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.208807 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.208962 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-29-iscsi {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.209108 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.209261 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.209415 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.209572 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.209790 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.209957 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.210114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.210259 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.210415 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.210567 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.210718 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.210863 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.211019 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.211254 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.211414 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.211632 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.211954 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.212268 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.212587 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.212935 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.213264 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.213583 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.214077 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.214276 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.214582 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.214903 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.215313 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-29-iscsi {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.215598 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.215771 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.215917 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.216072 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.216217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.216369 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.216540 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.216750 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.216909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.217061 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.217213 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.217397 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.217562 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.217767 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.217934 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.218087 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.218242 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.218387 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.218541 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.218703 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.218858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.219010 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.219164 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.219316 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.219624 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.219842 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.220163 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.220469 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.220622 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.220801 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.220964 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.221116 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.221260 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.221404 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.221554 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.221734 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.221971 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.222129 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.222285 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.222823 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.222990 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.223151 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.223822 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.224066 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.224066 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.224528 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.224771 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.225824 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.225990 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.226150 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.226303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.226450 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.226603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.226760 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.226913 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.227065 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.227211 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.227363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.227522 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.227667 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.227816 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.227971 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.228134 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.228280 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.228435 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.228580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.228722 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.228866 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.229015 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.229167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.229325 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.229478 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.229641 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.229962 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.230122 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.230366 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.230525 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.230689 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.230689 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.230985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.230985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.231278 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.231434 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.231587 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.231745 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.231897 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.232132 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.232291 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.232449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.232594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.232764 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.232921 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.232921 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.233211 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.233363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.233509 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.233509 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.233829 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.233829 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.234191 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.234522 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.234675 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.235046 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.235222 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.235370 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.235525 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.235525 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.236067 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.236226 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.236378 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.236538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.236692 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.236844 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.237009 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.237155 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.237308 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.237460 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.237604 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.237604 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.237923 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.238070 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.238214 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.238214 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.238504 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.238649 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.238807 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.238998 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.239692 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.239874 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.240166 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.240328 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.240475 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.240618 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.240770 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.240924 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.241069 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.241228 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.241380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.241533 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.241688 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.241872 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.242026 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.242274 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.242426 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.242581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.242736 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.242886 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.243037 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.243202 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.243347 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.243490 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.243659 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.243813 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.243967 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.244120 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.244350 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.244668 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.244828 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.245070 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.245229 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.245387 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.245547 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.248453 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.248645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.248832 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.248987 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.249136 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.249291 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.249449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.249595 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.249805 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.249969 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.250295 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.250451 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.250611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.250763 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.250914 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.251077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.251230 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.251399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.251545 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.251820 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.251985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.251985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.252292 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.252531 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.252696 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.252854 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.253000 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.253155 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.253308 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.253463 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.253608 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.253769 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.253931 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.254199 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.254386 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.255359 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.255525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.255671 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.255830 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.255984 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.256148 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.256294 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.256446 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.256593 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 11:44:11.256744 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.256899 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.257045 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.257197 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.257357 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.257502 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.257855 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.258016 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.258170 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.258335 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.258706 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.258860 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.259006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.259150 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.259302 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.259457 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.259602 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.259754 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.259900 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.260051 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.260197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.260197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.260671 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.260828 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.260981 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.261134 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.261279 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.261435 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.261580 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.261752 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.261904 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.262049 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.262261 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.262408 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.262648 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.262809 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.262955 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.263108 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.263267 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.263419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.263563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.263707 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.263861 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.264013 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.264170 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.264315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.264469 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.264762 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.264926 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.265079 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.265459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.265623 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.265792 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.265952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.266105 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.266264 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.266417 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.266562 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.266712 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.266857 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.267013 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.267169 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.267315 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.267459 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.267611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.267783 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.267998 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.268159 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.268159 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.268442 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.268594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.269420 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.269597 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.269806 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.269966 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.270112 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.270944 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.271102 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.271265 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.271412 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.271563 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.271708 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.271852 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.272002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.272161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.272317 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.272462 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.272606 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.272848 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.273008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.273163 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.273318 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.273464 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.273607 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.273788 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.273950 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.274110 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.274261 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.274418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.274569 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.274714 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.274867 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.275013 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.275163 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.275307 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.275665 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.275818 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.275973 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.276119 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.276270 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.276415 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.276571 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.276715 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.276873 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.277027 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.277172 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.277316 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.277460 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.277613 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.277811 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.277990 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.278214 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.278367 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.278532 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.278692 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.278845 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.278997 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.279142 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.279294 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.279633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.279794 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.279948 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.280093 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.280238 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.280389 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.280541 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.280712 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.280865 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.281162 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.281311 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.281523 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.281687 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.281872 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.282018 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.282170 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.282321 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.282609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.282781 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.282988 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.283150 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.283303 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.283448 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.283599 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.283758 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.283914 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.284058 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.284202 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.284352 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.284498 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.284652 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.284805 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.284958 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.285125 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.285269 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.285420 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.286005 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.286177 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.286340 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.286494 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.286647 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.286647 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.286948 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.287101 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.287247 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.287411 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.287565 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.287731 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.287731 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.288030 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.288200 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.288419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.288585 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.288751 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.288904 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.289063 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.289222 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.289373 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.289557 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.289922 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.290094 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.290257 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.290408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.290566 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.290726 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.290889 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.291048 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.291357 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.291510 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.291668 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.291829 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.291829 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.292137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.292298 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.292459 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.292629 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.292871 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.293038 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.293190 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.293350 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.293508 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.293508 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.293864 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.294019 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.294186 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.294186 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.294483 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.294634 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.294860 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.295024 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.295183 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.295335 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.295486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.295646 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.295964 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.296204 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.296362 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.296524 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.296524 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.296524 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.296972 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.297123 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.297279 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.297439 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.297599 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.297786 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.297952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.298103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.298263 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.298443 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.298670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.298837 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.298990 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.299141 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.299298 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.299456 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.299624 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.299776 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.300119 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.300286 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.300448 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.300608 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.300794 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.300954 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.301106 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.301415 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.301584 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.301772 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.301949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.302111 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.302264 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.302415 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.302573 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.302732 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.302981 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.303150 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.303309 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.303468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.303620 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.303772 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.303932 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.304085 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.304244 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.304395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.304546 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.304710 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.304863 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.305022 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.305185 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.305335 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.305486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.305650 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.305841 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.306179 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.306406 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.306572 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.306725 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.306892 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.306892 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.307197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.307357 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.307520 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.307671 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.307836 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.307998 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.308156 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.308308 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.308465 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.308739 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.308901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.309053 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.309203 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.309361 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.309530 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.309692 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.309870 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.310039 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.310369 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.310542 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.310695 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.310860 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.311012 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.311171 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.311469 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.311630 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.311781 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.311957 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.312112 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.312274 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.312426 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.312584 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.312752 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.312915 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.313161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.313317 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.313468 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.313628 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.313628 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.313971 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.314142 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.314294 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.314446 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.314606 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.314766 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.314925 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.315076 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.315227 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.315385 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.315543 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.315710 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.315870 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.316021 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.316333 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.316575 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.316747 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.316907 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.317596 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.317812 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.317986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.318138 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.318296 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.318462 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.318614 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.318783 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.319027 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.319191 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.319349 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.319502 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.319653 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.319817 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.319969 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.320120 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.320287 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.320626 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.320785 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.320950 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.321103 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.321264 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.321558 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.321749 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.321917 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.322084 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.322243 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.322401 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.322552 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.322718 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.322875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.323034 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.323266 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.323424 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.323586 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.323738 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.323899 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.324058 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.324220 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.324378 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.324530 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.324682 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.324862 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.324862 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.325256 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.325409 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.325566 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.325566 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.325913 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.326076 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.326228 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.326559 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.326785 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.326956 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.327111 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.327261 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.327412 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.327571 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.327723 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.327900 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.328650 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.328809 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.328962 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.329203 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.329369 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.329532 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.329693 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.329916 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.330070 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.330230 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.330405 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.330587 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.330936 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.331355 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.331510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.331828 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.331991 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.332230 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.332393 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.332547 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.332760 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.334162 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.334344 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.334513 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.334667 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.334819 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.334971 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.335382 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.335555 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.335710 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.335870 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.336023 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.336183 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.336337 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.336680 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.336929 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.337103 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.337262 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.337414 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.337566 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.337771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.337771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.338083 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.338236 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.338390 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.338552 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.338705 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.338857 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.339008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.339200 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.339432 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.339606 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.339767 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.339921 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.340072 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.340231 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.340393 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.340563 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.340716 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.341101 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.341268 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.341442 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.341610 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.342015 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.342179 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.342340 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.342495 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.342495 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.342798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.342959 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.343120 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.343223 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.343300 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.343396 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.343493 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.343587 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.343675 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.343761 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.343846 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.343931 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.344031 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.344136 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.344226 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.344312 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.344398 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.344483 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.344579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.344666 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.344752 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.344837 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.344923 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.345022 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.345117 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.345117 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.345284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.345378 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.345465 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.345567 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.345664 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.345903 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.346037 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.346151 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.346264 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.346400 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.346528 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.346646 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.346742 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.346831 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.347126 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.347239 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.347377 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.347526 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.347671 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.347814 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.347959 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.348091 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.348222 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.348336 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.348424 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.348510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.348607 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.348703 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.348791 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.348877 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.348962 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.349048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.349143 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.349232 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.349324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.349442 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.349531 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.349618 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.349728 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.349866 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.349956 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.350055 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.350144 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.350244 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.350339 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.350427 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.350519 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.350614 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.350709 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.350811 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.350899 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.351012 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.351124 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.351214 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.351300 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.351396 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.351490 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.351585 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.351678 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.351772 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.352119 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.352225 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.352321 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.352416 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.352511 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.352606 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.352700 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.352798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.352893 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.352989 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.353076 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.353169 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.353269 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.353357 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.353450 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.353545 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.353632 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.353765 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.353875 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.353972 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.354060 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.354141 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.354235 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.354335 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.354435 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.354523 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.354608 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.354700 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.354794 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.354880 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.354975 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.355064 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.355150 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.355242 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.355329 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.355423 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.355423 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.355597 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.355691 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.355778 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.355778 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.355979 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.355979 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.356148 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.356243 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.356336 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.356430 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.356525 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.356612 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.356704 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.356790 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.356881 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.356963 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.357083 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.357176 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.357251 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.357336 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.357420 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.357420 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.357593 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.357688 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.357788 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.357874 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.357963 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.358052 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.358146 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.358240 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.358327 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.358411 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.358495 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.358593 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.358686 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.358772 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.358856 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.358946 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.359038 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.359133 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.359219 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.359303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.359388 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.359478 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.359573 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.359659 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.359752 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.359844 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.359933 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.360015 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.360115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.360209 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.360295 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.360387 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.360473 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.360564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.360727 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.360823 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.360916 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.361008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.361095 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.361179 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.361276 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.361359 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.361440 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.361532 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.361618 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.361741 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.361843 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.361930 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.362045 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.362284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.362381 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.362482 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.362577 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.362671 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.362765 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.362851 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.362937 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.363031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.363125 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.363218 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.363310 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.363403 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.363496 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.363592 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.363680 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.363771 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.363857 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.363964 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.364062 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.364149 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.364234 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.364319 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.364403 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.364488 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.364583 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.364683 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.364772 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.364857 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.364957 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.365058 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.365146 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.365231 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.365325 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.365413 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.365508 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.365584 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.365584 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.365768 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.365857 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.365943 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.366039 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.366129 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.366212 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.366299 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.366384 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.366476 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.366572 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.366660 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.366745 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.366837 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.366837 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.367004 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.367086 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.367166 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.367259 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.367334 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.367413 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.367507 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.367602 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.367692 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.367784 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.367883 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.367971 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.368060 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.368135 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.368226 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.368313 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.368396 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.368573 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.368683 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.368894 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.368994 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.369216 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.369391 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.369520 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.369819 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.369921 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.370197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.370514 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.370846 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.370950 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.371188 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.371279 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.371530 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.371620 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.371851 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.371979 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.372195 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.372456 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.372546 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.372620 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.372841 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.372941 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.373171 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.373268 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.373516 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.373620 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.373961 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.374164 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.374485 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.375254 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.375510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.375620 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.375830 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.375961 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.376239 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.376554 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.376726 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.376868 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.377022 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.377166 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.377307 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.377396 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.377630 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.377805 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.377985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.378082 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.378308 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.378421 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.378625 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.378788 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.378951 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.379045 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.379265 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.379357 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.380115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.380227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.380434 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.380538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.380769 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.380869 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.381096 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.381200 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.381409 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.381509 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.381794 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.381933 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.382117 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.382235 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.382433 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.382544 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.382748 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.382853 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.383063 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.383176 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.383400 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.383510 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.383715 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.383828 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.384040 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.384143 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.384366 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.384477 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.384693 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.384803 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.385011 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.385114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.385334 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.385436 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.385653 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.385787 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.386020 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.386124 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.386349 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.386451 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.386676 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.386796 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.386991 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.387257 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.387426 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.387612 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.387874 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.387985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.388207 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.388339 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.388533 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.388627 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.388853 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.388961 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.389164 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.389265 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.389478 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.389574 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.389831 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.389943 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.390157 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.390252 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.390472 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.390574 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.390792 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.390893 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.391115 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.391207 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.391434 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.391529 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.391752 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.391848 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.392067 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.392162 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.392422 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.392546 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.392743 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.392858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.393071 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.393172 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.393396 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.393505 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.393752 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.393873 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.394096 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.394191 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.394417 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.394524 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.394742 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.394844 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.395067 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.395213 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.395933 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.396041 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.396255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.396349 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.396575 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.396683 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.396897 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.396992 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.397220 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.397325 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.397543 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.397646 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.397886 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.397989 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.398210 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.398313 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.398531 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.398625 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.398856 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.398957 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.399229 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.399426 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.399558 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.399771 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.399866 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.400100 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.400203 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.400426 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.400527 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.400750 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.401020 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.401115 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.401353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.401447 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.401694 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.401847 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.402040 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.402142 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.402362 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.402464 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.402684 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.402788 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.403008 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.403118 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.403344 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.403445 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.403660 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.403762 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.403976 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.404071 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.404297 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.404391 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.404615 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.404709 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.404929 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.405023 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.405259 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.405353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.405578 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.405670 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.405918 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.406013 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.406248 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.406360 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.406565 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.406665 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.406893 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.407110 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.407204 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.407472 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.407563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.407800 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.407893 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.408127 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.408229 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.408449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.408601 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.408772 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.408875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.409085 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.409188 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.409406 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.409500 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.409735 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.409832 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.410055 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.410233 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.410384 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.410480 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.410706 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.410820 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.411048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.411158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.411370 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.411474 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.411691 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.411791 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.412010 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.412214 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.412310 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.412538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.412632 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.412882 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.413025 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.413217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.413314 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.413549 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.413644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.413900 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.414015 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.414221 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.414324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.414541 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.414636 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.414854 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.414958 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.415167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.415259 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.415482 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.415576 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.415798 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.415891 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.416112 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.416207 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.416423 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.416516 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.416740 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.416842 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.417052 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.417155 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.417366 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.417465 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.417677 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.417880 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.418017 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.418269 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.418397 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.418629 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.418734 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.418956 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.419066 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.419290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.419394 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.419626 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.419722 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.419948 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.420047 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.420261 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.420355 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.420586 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.420680 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.420899 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.420999 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.421212 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.421314 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.421537 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.421640 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.421901 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.422128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.422224 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.422474 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.422588 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.422805 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.422907 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.423136 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.423232 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.423452 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.423548 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.423771 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.423866 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.424085 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.424214 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.424404 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.424501 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.424720 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.424814 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.425033 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.425135 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.425347 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.425450 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.425664 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.425855 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.426007 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.426103 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.426325 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.426442 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.426673 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.426775 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.426987 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.427091 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.427306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.427408 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.427618 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.427721 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.427935 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.428048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.428245 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.428340 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.428564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.428660 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.428876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.428988 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.429192 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.429286 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.429540 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.429645 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.429893 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.429991 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.430214 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.430315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.430528 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.430631 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.430848 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.430938 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.431165 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.431259 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.431493 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.431587 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.431808 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.431909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.432127 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.432243 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.432472 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.432598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.432791 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.432898 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.433104 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.433338 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.433537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.433680 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.433886 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.434033 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.434284 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.434418 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.434551 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.434713 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.434873 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.435007 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.435207 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.435354 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.435542 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.435652 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.435865 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.435960 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.436197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.436291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.436517 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.436612 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.436858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.436952 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.437172 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.437264 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.437492 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.437587 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.437838 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.437947 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.438161 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.438260 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.438480 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.438583 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.438792 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.438928 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.439107 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.439215 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.439424 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.439527 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.439739 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.439838 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.440055 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.440222 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.440370 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.440472 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.440690 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.440793 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.441005 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.441154 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.441323 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.441425 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.441639 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.441785 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.441979 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.442603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.442818 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.442914 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.443200 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.443307 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.443447 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.443589 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.443760 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.443857 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.444074 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.444168 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.444386 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.444490 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.444699 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.444794 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.445019 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.445121 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.445333 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.445429 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.445648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.445798 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.445985 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.446090 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.446302 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.446405 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.446614 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.446708 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.447342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.447499 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.447618 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.447731 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.447843 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.447962 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.448075 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.448201 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.448323 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.448438 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.448551 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.448671 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.448861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.448998 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.449194 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.449316 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.449525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.449654 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.449876 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.450008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.450194 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.450315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.452669 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.452799 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.452799 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.452988 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.453078 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.453166 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.453166 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.453363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.453466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.453561 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.453643 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.453752 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.453831 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.453938 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.454027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.454108 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.454189 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.454277 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.454358 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.454453 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.454536 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.454610 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.454696 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.454770 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.454850 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.454937 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.455021 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.455095 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.455187 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.455281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.455368 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.455467 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.455555 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.455640 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.455739 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.455827 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.455922 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.456405 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.456513 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.456724 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.456828 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.457044 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.457153 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.457371 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.457480 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.458244 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.458352 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.458584 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.458693 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.458922 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.459016 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.459252 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.459352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.459574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.459677 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.459907 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.460009 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.460226 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.460328 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.460558 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.460663 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.460888 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.460990 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.461212 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.461350 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.461531 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.461678 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.461898 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.462018 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.462219 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.462320 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 11:44:11.462541 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.462860 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.463177 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.463495 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.463818 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.464153 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.464488 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.464805 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.465140 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.465465 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.465820 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.466149 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.466471 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.466811 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.467139 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.467459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.467781 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.468099 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.468418 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.468741 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.469064 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.469402 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.469757 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.470096 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.470434 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.470829 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.471107 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.471464 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.471801 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.472125 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.472447 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.472763 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 11:44:11.473013 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 11:44:11.485821 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_db.sqlalchemy.engines [None req-c9cbef84-1b97-45c5-b937-adb7bc187c2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123508) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 11:44:11.496262 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_db.sqlalchemy.engines [None req-b8832c20-70dc-4183-be08-2a5f9188a61e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 11:44:11.554931 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.context [None req-c9cbef84-1b97-45c5-b937-adb7bc187c2c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7415e0ef-d04b-4a91-9f1a-2fb932d8b170(cell1) {{(pid=123508) load_cells /opt/stack/nova/nova/context.py:464}} May 12 11:44:11.559389 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c9cbef84-1b97-45c5-b937-adb7bc187c2c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:44:11.560986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c9cbef84-1b97-45c5-b937-adb7bc187c2c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:44:11.561837 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c9cbef84-1b97-45c5-b937-adb7bc187c2c None None] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:44:11.562998 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.context [None req-b8832c20-70dc-4183-be08-2a5f9188a61e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7415e0ef-d04b-4a91-9f1a-2fb932d8b170(cell1) {{(pid=123507) load_cells /opt/stack/nova/nova/context.py:464}} May 12 11:44:11.563792 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c9cbef84-1b97-45c5-b937-adb7bc187c2c None None] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:44:11.568044 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b8832c20-70dc-4183-be08-2a5f9188a61e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:44:11.569622 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b8832c20-70dc-4183-be08-2a5f9188a61e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:44:11.570472 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b8832c20-70dc-4183-be08-2a5f9188a61e None None] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:44:11.572419 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b8832c20-70dc-4183-be08-2a5f9188a61e None None] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:44:11.577583 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_db.sqlalchemy.engines [None req-c9cbef84-1b97-45c5-b937-adb7bc187c2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123508) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 11:44:11.580596 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_db.sqlalchemy.engines [None req-c9cbef84-1b97-45c5-b937-adb7bc187c2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123508) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 11:44:11.584358 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_db.sqlalchemy.engines [None req-b8832c20-70dc-4183-be08-2a5f9188a61e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 11:44:11.585469 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_db.sqlalchemy.engines [None req-b8832c20-70dc-4183-be08-2a5f9188a61e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 11:44:11.742792 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_db.sqlalchemy.engines [None req-c9cbef84-1b97-45c5-b937-adb7bc187c2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123508) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 11:44:11.744992 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_db.sqlalchemy.engines [None req-b8832c20-70dc-4183-be08-2a5f9188a61e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 11:44:12.069762 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: WARNING keystonemiddleware.auth_token [None req-c9cbef84-1b97-45c5-b937-adb7bc187c2c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 11:44:12.075220 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: WARNING keystonemiddleware.auth_token [None req-b8832c20-70dc-4183-be08-2a5f9188a61e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 11:44:12.077302 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: WARNING keystonemiddleware.auth_token [None req-c9cbef84-1b97-45c5-b937-adb7bc187c2c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 11:44:12.083553 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: WARNING keystonemiddleware.auth_token [None req-b8832c20-70dc-4183-be08-2a5f9188a61e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 11:44:12.424741 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: WARNING keystonemiddleware.auth_token [None req-c9cbef84-1b97-45c5-b937-adb7bc187c2c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 11:44:12.432160 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: WARNING keystonemiddleware.auth_token [None req-c9cbef84-1b97-45c5-b937-adb7bc187c2c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 11:44:12.434917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: WARNING keystonemiddleware.auth_token [None req-b8832c20-70dc-4183-be08-2a5f9188a61e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 11:44:12.437530 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f3b5a409c0 pid: 123508 (default app) May 12 11:44:12.441111 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: WARNING keystonemiddleware.auth_token [None req-b8832c20-70dc-4183-be08-2a5f9188a61e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 11:44:12.447097 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f3b5a409c0 pid: 123507 (default app) May 12 11:44:55.392069 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-7157250e-0ea1-4c75-aad7-3c8556f4f279 tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] Action: 'create', calling method: .version_select at 0x7f29f45d6280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-312779968", "metadata": {"Type": "work"}}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:44:55.424353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-7157250e-0ea1-4c75-aad7-3c8556f4f279 tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] Request method failure captured: May 12 11:44:55.424353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 11:44:55.424353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:44:55.424353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:44:55.424353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:44:55.424353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 121 May 12 11:44:55.424353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:44:55.424353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:44:55.424353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:44:55.424353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:44:55.424353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPM2M0bNjB_Rf8wRejZgJJEOi9Gt41_1rMZ7e1okfq4vW9Nu_4yC7UHCmEJw5xRvLcXCSLZS03ydRCkEz2deZkaENY98zNyI631b9rI7AUYNiPCm_k-fN4bs2s99MyzBD2ugHoPe00Ca-tGi6zLhjvVSdeqowPbXPXkzlBZTvtA4q1A May 12 11:44:55.424353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:44:55.424353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:44:55.424353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:44:55.424353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:44:55.424353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:44:55.424353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:44:55.424353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: 9ac9e0f81ffb4e37a6dfa644500012a3 May 12 11:44:55.424353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-VolumesNegativeTest-1461329439 May 12 11:44:55.424353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:44:55.424353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:44:55.425909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9ac9e0f81ffb4e37a6dfa644500012a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9ac9e0f81ffb4e37a6dfa644500012a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9ac9e0f81ffb4e37a6dfa644500012a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9ac9e0f81ffb4e37a6dfa644500012a3", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:44:55.425909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-VolumesNegativeTest-1461329439 May 12 11:44:55.425909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: 9ac9e0f81ffb4e37a6dfa644500012a3 May 12 11:44:55.425909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-VolumesNegativeTest-1461329439 May 12 11:44:55.425909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-VolumesNegativeTest-1461329439-project May 12 11:44:55.425909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:44:55.425909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:44:55.425909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 0eaa0f64a1c24f39a8f994bdd2eeae86 May 12 11:44:55.425909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-VolumesNegativeTest-1461329439-project May 12 11:44:55.425909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: May 12 11:44:55.425909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-312779968", "metadata": {"Type": "work"}}} May 12 11:44:55.425909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: May 12 11:44:55.425909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 11:44:55.426901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-312779968', 'metadata': {'Type': 'work'}}}} May 12 11:44:55.426901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:44:55.426901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:44:55.426901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 11:44:55.426901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 11:44:55.426901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 11:44:55.426901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise error May 12 11:44:55.426901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 12 11:44:55.426901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:55.426901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 12 11:44:55.426901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 11:44:55.426901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:55.426901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 11:44:55.426901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi '#$%' May 12 11:44:55.426901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:55.426901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:44:55.426901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:55.426901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:44:55.426901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:44:55.426901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:44:55.426901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:44:55.426901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:44:55.428580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 11:44:55.428580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 11:44:55.428580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:44:55.428580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:44:55.428580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 11:44:55.428580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 11:44:55.428580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 11:44:55.428580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 11:44:55.428580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 11:44:55.428580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 11:44:55.428580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 11:44:55.428580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:55.428580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:44:55.428580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:55.428580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:44:55.428580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:44:55.428580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:44:55.428580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 11:44:55.428580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 11:44:55.430094 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 11:44:55.430094 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:55.431206 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-7157250e-0ea1-4c75-aad7-3c8556f4f279 tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:44:55.432945 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-7157250e-0ea1-4c75-aad7-3c8556f4f279 tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.260230 May 12 11:44:55.433693 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1155 bytes} [Thu May 12 11:44:54 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1262 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 11:44:55.442960 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-fb3d27a3-5ad1-4713-bcb6-f1d0328050dc tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] Action: 'create', calling method: .version_select at 0x7f29f44795e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-598371655", "metadata": {"Type": "work"}}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:44:55.445905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-fb3d27a3-5ad1-4713-bcb6-f1d0328050dc tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] Request method failure captured: May 12 11:44:55.445905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 11:44:55.445905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:44:55.445905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:44:55.445905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:44:55.445905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 119 May 12 11:44:55.445905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:44:55.445905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:44:55.445905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:44:55.445905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:44:55.445905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPM2M0bNjB_Rf8wRejZgJJEOi9Gt41_1rMZ7e1okfq4vW9Nu_4yC7UHCmEJw5xRvLcXCSLZS03ydRCkEz2deZkaENY98zNyI631b9rI7AUYNiPCm_k-fN4bs2s99MyzBD2ugHoPe00Ca-tGi6zLhjvVSdeqowPbXPXkzlBZTvtA4q1A May 12 11:44:55.445905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:44:55.445905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:44:55.445905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:44:55.445905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:44:55.445905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:44:55.445905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:44:55.445905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: 9ac9e0f81ffb4e37a6dfa644500012a3 May 12 11:44:55.445905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-VolumesNegativeTest-1461329439 May 12 11:44:55.445905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:44:55.445905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:44:55.447489 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9ac9e0f81ffb4e37a6dfa644500012a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9ac9e0f81ffb4e37a6dfa644500012a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9ac9e0f81ffb4e37a6dfa644500012a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9ac9e0f81ffb4e37a6dfa644500012a3", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:44:55.447489 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-VolumesNegativeTest-1461329439 May 12 11:44:55.447489 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: 9ac9e0f81ffb4e37a6dfa644500012a3 May 12 11:44:55.447489 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-VolumesNegativeTest-1461329439 May 12 11:44:55.447489 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-VolumesNegativeTest-1461329439-project May 12 11:44:55.447489 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:44:55.447489 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:44:55.447489 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 0eaa0f64a1c24f39a8f994bdd2eeae86 May 12 11:44:55.447489 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-VolumesNegativeTest-1461329439-project May 12 11:44:55.447489 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: May 12 11:44:55.447489 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-598371655", "metadata": {"Type": "work"}}} May 12 11:44:55.447489 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: May 12 11:44:55.447489 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 11:44:55.448438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-598371655', 'metadata': {'Type': 'work'}}}} May 12 11:44:55.448438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:44:55.448438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:44:55.448438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 11:44:55.448438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 11:44:55.448438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 11:44:55.448438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise error May 12 11:44:55.448438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 12 11:44:55.448438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:55.448438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 12 11:44:55.448438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 11:44:55.448438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:55.448438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 11:44:55.448438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi '0' May 12 11:44:55.448438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:55.448438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:44:55.448438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:55.448438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:44:55.448438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:44:55.448438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:44:55.448438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:44:55.448438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:44:55.449909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 11:44:55.449909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 11:44:55.449909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:44:55.449909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:44:55.449909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 11:44:55.449909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 11:44:55.449909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 11:44:55.449909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 11:44:55.449909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 11:44:55.449909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 11:44:55.449909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 11:44:55.449909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:55.449909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:44:55.449909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:55.449909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:44:55.449909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:44:55.449909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:44:55.449909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 11:44:55.449909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 11:44:55.451027 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 11:44:55.451027 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:55.452016 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-fb3d27a3-5ad1-4713-bcb6-f1d0328050dc tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:44:55.453001 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-fb3d27a3-5ad1-4713-bcb6-f1d0328050dc tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013987 May 12 11:44:55.458739 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 2/2] 10.222.0.58 () {60 vars in 1155 bytes} [Thu May 12 11:44:55 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 12 11:44:55.467926 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-878d52b2-b18e-4198-8cfa-0cdec63e3e84 tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] Action: 'create', calling method: .version_select at 0x7f29f45d65e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-418518643", "metadata": {"Type": "work"}}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:44:55.481949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-878d52b2-b18e-4198-8cfa-0cdec63e3e84 tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] Request method failure captured: May 12 11:44:55.481949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 11:44:55.481949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:44:55.481949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:44:55.481949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:44:55.481949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 118 May 12 11:44:55.481949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:44:55.481949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:44:55.481949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:44:55.481949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:44:55.481949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPM2M0bNjB_Rf8wRejZgJJEOi9Gt41_1rMZ7e1okfq4vW9Nu_4yC7UHCmEJw5xRvLcXCSLZS03ydRCkEz2deZkaENY98zNyI631b9rI7AUYNiPCm_k-fN4bs2s99MyzBD2ugHoPe00Ca-tGi6zLhjvVSdeqowPbXPXkzlBZTvtA4q1A May 12 11:44:55.481949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:44:55.481949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:44:55.481949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:44:55.481949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:44:55.481949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:44:55.481949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:44:55.481949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: 9ac9e0f81ffb4e37a6dfa644500012a3 May 12 11:44:55.481949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-VolumesNegativeTest-1461329439 May 12 11:44:55.481949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:44:55.481949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:44:55.483569 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9ac9e0f81ffb4e37a6dfa644500012a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9ac9e0f81ffb4e37a6dfa644500012a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9ac9e0f81ffb4e37a6dfa644500012a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9ac9e0f81ffb4e37a6dfa644500012a3", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:44:55.483569 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-VolumesNegativeTest-1461329439 May 12 11:44:55.483569 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: 9ac9e0f81ffb4e37a6dfa644500012a3 May 12 11:44:55.483569 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-VolumesNegativeTest-1461329439 May 12 11:44:55.483569 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-VolumesNegativeTest-1461329439-project May 12 11:44:55.483569 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:44:55.483569 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:44:55.483569 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 0eaa0f64a1c24f39a8f994bdd2eeae86 May 12 11:44:55.483569 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-VolumesNegativeTest-1461329439-project May 12 11:44:55.483569 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: May 12 11:44:55.483569 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-418518643", "metadata": {"Type": "work"}}} May 12 11:44:55.483569 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: May 12 11:44:55.483569 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 11:44:55.484525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-418518643', 'metadata': {'Type': 'work'}}}} May 12 11:44:55.484525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:44:55.484525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:44:55.484525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 11:44:55.484525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 11:44:55.484525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 11:44:55.484525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise error May 12 11:44:55.484525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 12 11:44:55.484525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:55.484525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 12 11:44:55.484525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 11:44:55.484525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:55.484525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 11:44:55.484525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi '' May 12 11:44:55.484525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:55.484525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:44:55.484525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:55.484525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:44:55.484525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:44:55.484525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:44:55.484525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:44:55.484525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:44:55.486729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 11:44:55.486729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 11:44:55.486729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:44:55.486729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:44:55.486729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 11:44:55.486729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 11:44:55.486729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 11:44:55.486729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 11:44:55.486729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 11:44:55.486729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 11:44:55.486729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 11:44:55.486729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:55.486729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:44:55.486729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:55.486729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:44:55.486729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:44:55.486729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:44:55.486729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 11:44:55.486729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 11:44:55.488093 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 11:44:55.488093 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:55.489133 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-878d52b2-b18e-4198-8cfa-0cdec63e3e84 tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:44:55.490162 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-878d52b2-b18e-4198-8cfa-0cdec63e3e84 tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026630 May 12 11:44:55.491255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 3/3] 10.222.0.58 () {60 vars in 1155 bytes} [Thu May 12 11:44:55 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 12 11:44:55.499753 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-be821153-a4f7-431c-b826-598a13d6b9ab tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] Calling method '.version_select at 0x7f29f4488310>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:44:55.670449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-6fe31fa7-f98a-4b08-a786-9e537843ea1c tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Action: 'create', calling method: .version_select at 0x7f29f45d5280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1095789342"}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:44:56.586928 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-be821153-a4f7-431c-b826-598a13d6b9ab tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] HTTP exception thrown: Volume tempest-invalid-1458323504 could not be found. May 12 11:44:56.591380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-be821153-a4f7-431c-b826-598a13d6b9ab tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] Request method failure captured: May 12 11:44:56.591380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1458323504 HTTP/1.1 May 12 11:44:56.591380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:44:56.591380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:44:56.591380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:44:56.591380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:44:56.591380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:44:56.591380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:44:56.591380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:44:56.591380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:44:56.591380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPM2M0bNjB_Rf8wRejZgJJEOi9Gt41_1rMZ7e1okfq4vW9Nu_4yC7UHCmEJw5xRvLcXCSLZS03ydRCkEz2deZkaENY98zNyI631b9rI7AUYNiPCm_k-fN4bs2s99MyzBD2ugHoPe00Ca-tGi6zLhjvVSdeqowPbXPXkzlBZTvtA4q1A May 12 11:44:56.591380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:44:56.591380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:44:56.591380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:44:56.591380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:44:56.591380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:44:56.591380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:44:56.591380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: 9ac9e0f81ffb4e37a6dfa644500012a3 May 12 11:44:56.591380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-VolumesNegativeTest-1461329439 May 12 11:44:56.591380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:44:56.591380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:44:56.602098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9ac9e0f81ffb4e37a6dfa644500012a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9ac9e0f81ffb4e37a6dfa644500012a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9ac9e0f81ffb4e37a6dfa644500012a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9ac9e0f81ffb4e37a6dfa644500012a3", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:44:56.602098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-VolumesNegativeTest-1461329439 May 12 11:44:56.602098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: 9ac9e0f81ffb4e37a6dfa644500012a3 May 12 11:44:56.602098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-VolumesNegativeTest-1461329439 May 12 11:44:56.602098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-VolumesNegativeTest-1461329439-project May 12 11:44:56.602098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:44:56.602098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:44:56.602098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 0eaa0f64a1c24f39a8f994bdd2eeae86 May 12 11:44:56.602098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-VolumesNegativeTest-1461329439-project May 12 11:44:56.602098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: May 12 11:44:56.602098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Volume tempest-invalid-1458323504 could not be found. May 12 11:44:56.602098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': 'tempest-invalid-1458323504'} May 12 11:44:56.602098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:44:56.602956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:44:56.602956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 11:44:56.602956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 11:44:56.602956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 11:44:56.602956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 11:44:56.602956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 11:44:56.602956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 11:44:56.602956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 11:44:56.602956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 11:44:56.602956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 11:44:56.602956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 11:44:56.602956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 11:44:56.602956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 11:44:56.602956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 11:44:56.602956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 11:44:56.602956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1458323504 could not be found. (HTTP 404) (Request-ID: req-d8ae8ae6-aa24-420f-8389-f9132cebe715) May 12 11:44:56.602956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:56.602956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:44:56.602956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:56.604172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:44:56.604172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 11:44:56.604172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 11:44:56.604172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 11:44:56.604172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 11:44:56.604172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 11:44:56.604172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 11:44:56.604172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 11:44:56.604172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 11:44:56.604172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 11:44:56.604172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 11:44:56.604172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 11:44:56.604172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 11:44:56.604172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 11:44:56.604172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 11:44:56.604172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 11:44:56.604172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 11:44:56.604172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 11:44:56.604172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 11:44:56.605454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 11:44:56.605454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 11:44:56.605454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 11:44:56.605454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 11:44:56.605454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1458323504 could not be found. May 12 11:44:56.605454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:56.605454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:44:56.605454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:56.605454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:44:56.605454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:44:56.605454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:44:56.605454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:44:56.605454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:44:56.605454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 11:44:56.605454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 11:44:56.605454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:44:56.605454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:44:56.605454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 11:44:56.605454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:44:56.605454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1458323504 could not be found. May 12 11:44:56.606909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:56.606909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:44:56.606909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:56.606909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:44:56.606909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:44:56.606909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:44:56.606909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:44:56.606909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:44:56.606909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1458323504 could not be found. May 12 11:44:56.606909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:44:56.611465 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-be821153-a4f7-431c-b826-598a13d6b9ab tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] Returning 404 to user: Volume tempest-invalid-1458323504 could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:44:56.611465 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-be821153-a4f7-431c-b826-598a13d6b9ab tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1458323504" status: 404 len: 99 microversion: 2.1 time: 1.114394 May 12 11:44:56.615916 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 4/4] 10.222.0.58 () {58 vars in 1217 bytes} [Thu May 12 11:44:55 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1458323504 => generated 99 bytes in 1120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 12 11:44:56.756907 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-dd41f96e-b35d-4328-a856-2c4ef9fa1e83 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-495222533", "imageRef": "576e8b7b-771b-47aa-89c6-ff04accc9bea", "flavorRef": "452", "networks": [{"uuid": "6ae6c482-e56f-46d6-ac05-4ad378b6fe26"}]}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:44:56.953001 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.network.neutron [None req-dd41f96e-b35d-4328-a856-2c4ef9fa1e83 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] validate_networks() for [('6ae6c482-e56f-46d6-ac05-4ad378b6fe26', None, None, None, None, None)] {{(pid=123508) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 11:44:58.168950 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-6fe31fa7-f98a-4b08-a786-9e537843ea1c tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.835922 May 12 11:44:58.177333 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 1/5] 10.222.0.58 () {60 vars in 1154 bytes} [Thu May 12 11:44:54 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3846 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 12 11:44:58.183132 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-00c56aeb-3ee0-489f-80cc-5d9a54f0d80e tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004383 May 12 11:44:58.187445 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 2/6] 10.222.0.58 () {58 vars in 1139 bytes} [Thu May 12 11:44:58 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 12 11:44:58.197095 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-abff3b62-cc86-454a-a7a0-6e5d7c38f425 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Calling method '.version_select at 0x7f29f442f4c0>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:44:58.467021 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-abff3b62-cc86-454a-a7a0-6e5d7c38f425 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/e2e024cc-e4e5-446c-8364-ed3e6bdb5e95" status: 200 len: 345 microversion: 2.1 time: 0.278302 May 12 11:44:58.467601 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 3/7] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 12 11:44:58 2022] GET /compute/v2.1/os-volumes/e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 => generated 345 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:44:58.490113 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-2e4e339b-4118-439b-bdea-ca8e1efff80d tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012667 May 12 11:44:58.492659 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 4/8] 10.222.0.58 () {58 vars in 1136 bytes} [Thu May 12 11:44:58 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 12 11:44:58.519487 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-307d6cb8-3a9c-4d3c-8daa-75c7fd4822fe tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] Calling method '.version_select at 0x7f29f442f3a0>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:44:58.586942 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-307d6cb8-3a9c-4d3c-8daa-75c7fd4822fe tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] HTTP exception thrown: Volume 6a08fb30-4c8c-4e0b-85f3-1a10c08d7cbd could not be found. May 12 11:44:58.591564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-307d6cb8-3a9c-4d3c-8daa-75c7fd4822fe tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] Request method failure captured: May 12 11:44:58.591564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: DELETE /compute/v2.1/os-volumes/6a08fb30-4c8c-4e0b-85f3-1a10c08d7cbd HTTP/1.1 May 12 11:44:58.591564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:44:58.591564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:44:58.591564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:44:58.591564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 0 May 12 11:44:58.591564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:44:58.591564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:44:58.591564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:44:58.591564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:44:58.591564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPM2M0bNjB_Rf8wRejZgJJEOi9Gt41_1rMZ7e1okfq4vW9Nu_4yC7UHCmEJw5xRvLcXCSLZS03ydRCkEz2deZkaENY98zNyI631b9rI7AUYNiPCm_k-fN4bs2s99MyzBD2ugHoPe00Ca-tGi6zLhjvVSdeqowPbXPXkzlBZTvtA4q1A May 12 11:44:58.591564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:44:58.591564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:44:58.591564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:44:58.591564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:44:58.591564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:44:58.591564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:44:58.591564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: 9ac9e0f81ffb4e37a6dfa644500012a3 May 12 11:44:58.591564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-VolumesNegativeTest-1461329439 May 12 11:44:58.591564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:44:58.591564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:44:58.592906 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9ac9e0f81ffb4e37a6dfa644500012a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9ac9e0f81ffb4e37a6dfa644500012a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9ac9e0f81ffb4e37a6dfa644500012a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9ac9e0f81ffb4e37a6dfa644500012a3", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:44:58.592906 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-VolumesNegativeTest-1461329439 May 12 11:44:58.592906 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: 9ac9e0f81ffb4e37a6dfa644500012a3 May 12 11:44:58.592906 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-VolumesNegativeTest-1461329439 May 12 11:44:58.592906 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-VolumesNegativeTest-1461329439-project May 12 11:44:58.592906 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:44:58.592906 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:44:58.592906 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: 0eaa0f64a1c24f39a8f994bdd2eeae86 May 12 11:44:58.592906 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-VolumesNegativeTest-1461329439-project May 12 11:44:58.592906 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: May 12 11:44:58.592906 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Volume 6a08fb30-4c8c-4e0b-85f3-1a10c08d7cbd could not be found. May 12 11:44:58.592906 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'id': '6a08fb30-4c8c-4e0b-85f3-1a10c08d7cbd'} May 12 11:44:58.592906 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:44:58.593732 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:44:58.593732 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 11:44:58.593732 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 11:44:58.593732 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 11:44:58.593732 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 11:44:58.593732 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 11:44:58.593732 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 11:44:58.593732 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 11:44:58.593732 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 11:44:58.593732 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 11:44:58.593732 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 11:44:58.593732 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 11:44:58.593732 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 11:44:58.593732 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 11:44:58.593732 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 11:44:58.593732 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6a08fb30-4c8c-4e0b-85f3-1a10c08d7cbd could not be found. (HTTP 404) (Request-ID: req-57336221-ca06-4b5e-9a8a-7926ac8e5c90) May 12 11:44:58.593732 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:44:58.593732 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:44:58.593732 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:44:58.596284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:44:58.596284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 11:44:58.596284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 11:44:58.596284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 11:44:58.596284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 11:44:58.596284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 11:44:58.596284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 11:44:58.596284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 11:44:58.596284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 11:44:58.596284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 11:44:58.596284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 11:44:58.596284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 11:44:58.596284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 11:44:58.596284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 11:44:58.596284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 11:44:58.596284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 11:44:58.596284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 11:44:58.596284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 11:44:58.596284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 11:44:58.597468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 11:44:58.597468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 11:44:58.597468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 11:44:58.597468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 11:44:58.597468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6a08fb30-4c8c-4e0b-85f3-1a10c08d7cbd could not be found. May 12 11:44:58.597468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:44:58.597468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:44:58.597468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:44:58.597468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:44:58.597468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:44:58.597468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:44:58.597468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:44:58.597468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:44:58.597468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 11:44:58.597468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 11:44:58.597468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:44:58.597468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:44:58.597468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 11:44:58.597468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:44:58.598605 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6a08fb30-4c8c-4e0b-85f3-1a10c08d7cbd could not be found. May 12 11:44:58.598605 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:44:58.598605 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:44:58.598605 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:44:58.598605 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:44:58.598605 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:44:58.598605 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:44:58.598605 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:44:58.598605 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:44:58.598605 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6a08fb30-4c8c-4e0b-85f3-1a10c08d7cbd could not be found. May 12 11:44:58.598605 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:44:58.598605 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-307d6cb8-3a9c-4d3c-8daa-75c7fd4822fe tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] Returning 404 to user: Volume 6a08fb30-4c8c-4e0b-85f3-1a10c08d7cbd could not be found. {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:44:58.598605 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-307d6cb8-3a9c-4d3c-8daa-75c7fd4822fe tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/6a08fb30-4c8c-4e0b-85f3-1a10c08d7cbd" status: 404 len: 109 microversion: 2.1 time: 0.091383 May 12 11:44:58.598605 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 5/9] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 12 11:44:58 2022] DELETE /compute/v2.1/os-volumes/6a08fb30-4c8c-4e0b-85f3-1a10c08d7cbd => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 11:44:58.606844 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-a44b7472-87f9-4286-a7d0-273447f80759 tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] Calling method '.version_select at 0x7f29f4506c10>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:44:58.657839 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-a44b7472-87f9-4286-a7d0-273447f80759 tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] HTTP exception thrown: Volume 113607a9-b563-493a-8e91-0f1a39df0c9b could not be found. May 12 11:44:58.660291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-a44b7472-87f9-4286-a7d0-273447f80759 tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] Request method failure captured: May 12 11:44:58.660291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: GET /compute/v2.1/os-volumes/113607a9-b563-493a-8e91-0f1a39df0c9b HTTP/1.1 May 12 11:44:58.660291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:44:58.660291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:44:58.660291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:44:58.660291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 0 May 12 11:44:58.660291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:44:58.660291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:44:58.660291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:44:58.660291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:44:58.660291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPM2M0bNjB_Rf8wRejZgJJEOi9Gt41_1rMZ7e1okfq4vW9Nu_4yC7UHCmEJw5xRvLcXCSLZS03ydRCkEz2deZkaENY98zNyI631b9rI7AUYNiPCm_k-fN4bs2s99MyzBD2ugHoPe00Ca-tGi6zLhjvVSdeqowPbXPXkzlBZTvtA4q1A May 12 11:44:58.660291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:44:58.660291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:44:58.660291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:44:58.660291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:44:58.660291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:44:58.660291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:44:58.660291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: 9ac9e0f81ffb4e37a6dfa644500012a3 May 12 11:44:58.660291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-VolumesNegativeTest-1461329439 May 12 11:44:58.660291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:44:58.660291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:44:58.661962 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9ac9e0f81ffb4e37a6dfa644500012a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9ac9e0f81ffb4e37a6dfa644500012a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9ac9e0f81ffb4e37a6dfa644500012a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9ac9e0f81ffb4e37a6dfa644500012a3", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:44:58.661962 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-VolumesNegativeTest-1461329439 May 12 11:44:58.661962 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: 9ac9e0f81ffb4e37a6dfa644500012a3 May 12 11:44:58.661962 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-VolumesNegativeTest-1461329439 May 12 11:44:58.661962 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-VolumesNegativeTest-1461329439-project May 12 11:44:58.661962 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:44:58.661962 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:44:58.661962 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: 0eaa0f64a1c24f39a8f994bdd2eeae86 May 12 11:44:58.661962 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-VolumesNegativeTest-1461329439-project May 12 11:44:58.661962 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: May 12 11:44:58.661962 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Volume 113607a9-b563-493a-8e91-0f1a39df0c9b could not be found. May 12 11:44:58.661962 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'id': '113607a9-b563-493a-8e91-0f1a39df0c9b'} May 12 11:44:58.661962 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:44:58.662985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:44:58.662985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 11:44:58.662985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 11:44:58.662985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 11:44:58.662985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 11:44:58.662985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 11:44:58.662985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 11:44:58.662985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 11:44:58.662985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 11:44:58.662985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 11:44:58.662985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 11:44:58.662985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 11:44:58.662985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 11:44:58.662985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 11:44:58.662985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 11:44:58.662985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 113607a9-b563-493a-8e91-0f1a39df0c9b could not be found. (HTTP 404) (Request-ID: req-7d2b2f22-5885-471c-aac9-7893e8a617f9) May 12 11:44:58.662985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:44:58.662985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:44:58.662985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:44:58.664375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:44:58.664375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 11:44:58.664375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 11:44:58.664375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 11:44:58.664375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 11:44:58.664375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 11:44:58.664375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 11:44:58.664375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 11:44:58.664375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 11:44:58.664375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 11:44:58.664375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 11:44:58.664375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 11:44:58.664375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 11:44:58.664375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 11:44:58.664375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 11:44:58.664375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 11:44:58.664375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 11:44:58.664375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 11:44:58.664375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 11:44:58.665466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 11:44:58.665466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 11:44:58.665466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 11:44:58.665466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 11:44:58.665466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 113607a9-b563-493a-8e91-0f1a39df0c9b could not be found. May 12 11:44:58.665466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:44:58.665466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:44:58.665466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:44:58.665466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:44:58.665466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:44:58.665466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:44:58.665466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:44:58.665466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:44:58.665466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 11:44:58.665466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 11:44:58.665466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:44:58.665466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:44:58.665466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 11:44:58.665466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:44:58.667432 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 113607a9-b563-493a-8e91-0f1a39df0c9b could not be found. May 12 11:44:58.667432 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:44:58.667432 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:44:58.667432 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:44:58.667432 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:44:58.667432 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:44:58.667432 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:44:58.667432 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:44:58.667432 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:44:58.667432 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 113607a9-b563-493a-8e91-0f1a39df0c9b could not be found. May 12 11:44:58.667432 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:44:58.673389 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-a44b7472-87f9-4286-a7d0-273447f80759 tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] Returning 404 to user: Volume 113607a9-b563-493a-8e91-0f1a39df0c9b could not be found. {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:44:58.674537 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-a44b7472-87f9-4286-a7d0-273447f80759 tempest-VolumesNegativeTest-1461329439 tempest-VolumesNegativeTest-1461329439-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/113607a9-b563-493a-8e91-0f1a39df0c9b" status: 404 len: 109 microversion: 2.1 time: 0.072889 May 12 11:44:58.676932 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 6/10] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 12 11:44:58 2022] GET /compute/v2.1/os-volumes/113607a9-b563-493a-8e91-0f1a39df0c9b => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 11:44:59.457428 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-dd41f96e-b35d-4328-a856-2c4ef9fa1e83 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Flavor limits 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 11:44:59.458053 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-dd41f96e-b35d-4328-a856-2c4ef9fa1e83 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Image limits 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 11:44:59.458338 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-dd41f96e-b35d-4328-a856-2c4ef9fa1e83 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Flavor pref 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 11:44:59.458758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-dd41f96e-b35d-4328-a856-2c4ef9fa1e83 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Image pref 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 11:44:59.459172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-dd41f96e-b35d-4328-a856-2c4ef9fa1e83 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 11:44:59.481161 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-8386df97-d6c1-40f2-bcbd-162e6bd8d139 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Calling method '.version_select at 0x7f29f441c1f0>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:44:59.500390 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dd41f96e-b35d-4328-a856-2c4ef9fa1e83 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:44:59.500390 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dd41f96e-b35d-4328-a856-2c4ef9fa1e83 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:44:59.506246 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dd41f96e-b35d-4328-a856-2c4ef9fa1e83 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:44:59.506715 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dd41f96e-b35d-4328-a856-2c4ef9fa1e83 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:44:59.554110 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-8386df97-d6c1-40f2-bcbd-162e6bd8d139 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/e2e024cc-e4e5-446c-8364-ed3e6bdb5e95" status: 200 len: 346 microversion: 2.1 time: 0.077407 May 12 11:44:59.554934 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 7/11] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 12 11:44:59 2022] GET /compute/v2.1/os-volumes/e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:44:59.566871 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-475af7bd-f87c-41cb-890c-415c462ffc7d tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Action: 'create', calling method: .version_select at 0x7f29f441c820>, body: {"snapshot": {"volume_id": "e2e024cc-e4e5-446c-8364-ed3e6bdb5e95", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1208342104"}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:44:59.602231 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-dd41f96e-b35d-4328-a856-2c4ef9fa1e83 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Getting quotas for project 4b52f1a625344430ba655dc6c40eebb3. Resources: {'ram', 'cores', 'instances'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:44:59.615452 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-dd41f96e-b35d-4328-a856-2c4ef9fa1e83 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Getting quotas for user 3fc5418744ce43cf8074de1d2f0de6cf and project 4b52f1a625344430ba655dc6c40eebb3. Resources: {'ram', 'cores', 'instances'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:44:59.658358 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-dd41f96e-b35d-4328-a856-2c4ef9fa1e83 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Going to run 1 instances... {{(pid=123508) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 11:44:59.661468 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-dd41f96e-b35d-4328-a856-2c4ef9fa1e83 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='576e8b7b-771b-47aa-89c6-ff04accc9bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 11:44:59.884311 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-dd41f96e-b35d-4328-a856-2c4ef9fa1e83 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.266639 May 12 11:44:59.884958 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 5/12] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 12 11:44:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 11:44:59.898257 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-3187e0cf-ec76-4053-b28b-9301f5082025 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:44:59.899047 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-3187e0cf-ec76-4053-b28b-9301f5082025 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:00.076037 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-475af7bd-f87c-41cb-890c-415c462ffc7d tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.513900 May 12 11:45:00.077049 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 8/13] 10.222.0.58 () {60 vars in 1161 bytes} [Thu May 12 11:44:59 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:45:00.087918 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-65a3a195-309f-4397-b1b7-5d9fcfc43596 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Calling method '.version_select at 0x7f29f442f0d0>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:00.173233 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-65a3a195-309f-4397-b1b7-5d9fcfc43596 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/714e6de3-a5e2-42af-839c-54212462967e" status: 200 len: 287 microversion: 2.1 time: 0.089524 May 12 11:45:00.174277 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 9/14] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 12 11:45:00 2022] GET /compute/v2.1/os-snapshots/714e6de3-a5e2-42af-839c-54212462967e => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:45:00.184338 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-17df54d1-5d1a-4c34-be60-922d73ea1513 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Calling method '.version_select at 0x7f29f4729d30>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:00.292892 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-17df54d1-5d1a-4c34-be60-922d73ea1513 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.113037 May 12 11:45:00.294041 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 10/15] 10.222.0.58 () {58 vars in 1139 bytes} [Thu May 12 11:45:00 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:45:00.303797 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-f63bda02-a3ad-4fcb-b4e0-1abef87ce9be tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Calling method '.version_select at 0x7f29f441c160>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:00.474831 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-3187e0cf-ec76-4053-b28b-9301f5082025 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5418744ce43cf8074de1d2f0de6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52f1a625344430ba655dc6c40eebb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:00.484099 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-f63bda02-a3ad-4fcb-b4e0-1abef87ce9be tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/714e6de3-a5e2-42af-839c-54212462967e" status: 200 len: 287 microversion: 2.1 time: 0.183979 May 12 11:45:00.484673 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 11/16] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 12 11:45:00 2022] GET /compute/v2.1/os-snapshots/714e6de3-a5e2-42af-839c-54212462967e => generated 287 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:45:00.502459 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-3187e0cf-ec76-4053-b28b-9301f5082025 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 200 len: 1214 microversion: 2.1 time: 0.610651 May 12 11:45:00.514939 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 6/17] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:44:59 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 1214 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:01.503213 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-972c1fcd-e07e-4915-a415-5a09cacbfd9a tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Calling method '.version_select at 0x7f29f441c550>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:01.521393 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-effdd5ae-00af-4dcf-b3ba-07ba2cead5dd tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:01.522061 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-effdd5ae-00af-4dcf-b3ba-07ba2cead5dd tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:01.692117 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-972c1fcd-e07e-4915-a415-5a09cacbfd9a tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/714e6de3-a5e2-42af-839c-54212462967e" status: 200 len: 287 microversion: 2.1 time: 0.199768 May 12 11:45:01.692870 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 12/18] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 12 11:45:01 2022] GET /compute/v2.1/os-snapshots/714e6de3-a5e2-42af-839c-54212462967e => generated 287 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:45:01.839873 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-effdd5ae-00af-4dcf-b3ba-07ba2cead5dd tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5418744ce43cf8074de1d2f0de6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52f1a625344430ba655dc6c40eebb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:01.848783 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-effdd5ae-00af-4dcf-b3ba-07ba2cead5dd tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 200 len: 1214 microversion: 2.1 time: 0.330808 May 12 11:45:01.849546 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 7/19] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:01 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 1214 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:02.704809 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-2800cd6d-2024-46be-82b8-8b1922e2f111 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Calling method '.version_select at 0x7f29f441cca0>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:02.767290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-2800cd6d-2024-46be-82b8-8b1922e2f111 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/714e6de3-a5e2-42af-839c-54212462967e" status: 200 len: 287 microversion: 2.1 time: 0.067026 May 12 11:45:02.768304 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 13/20] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 12 11:45:02 2022] GET /compute/v2.1/os-snapshots/714e6de3-a5e2-42af-839c-54212462967e => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:45:02.866978 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-0b2a7d9c-4e9a-4337-a330-a449747ebd03 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:02.868135 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-0b2a7d9c-4e9a-4337-a330-a449747ebd03 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:02.880134 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0b2a7d9c-4e9a-4337-a330-a449747ebd03 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:02.880790 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0b2a7d9c-4e9a-4337-a330-a449747ebd03 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:02.881797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0b2a7d9c-4e9a-4337-a330-a449747ebd03 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:02.884363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0b2a7d9c-4e9a-4337-a330-a449747ebd03 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:03.239551 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-0b2a7d9c-4e9a-4337-a330-a449747ebd03 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5418744ce43cf8074de1d2f0de6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52f1a625344430ba655dc6c40eebb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:03.280449 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-0b2a7d9c-4e9a-4337-a330-a449747ebd03 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 200 len: 1218 microversion: 2.1 time: 0.416534 May 12 11:45:03.282757 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 8/21] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:02 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 1218 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:03.782050 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-39118a98-863d-435b-8d9f-0e78aa8b51ff tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Calling method '.version_select at 0x7f29f442f700>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:03.862251 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-39118a98-863d-435b-8d9f-0e78aa8b51ff tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/714e6de3-a5e2-42af-839c-54212462967e" status: 200 len: 288 microversion: 2.1 time: 0.085974 May 12 11:45:03.862848 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 14/22] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 12 11:45:03 2022] GET /compute/v2.1/os-snapshots/714e6de3-a5e2-42af-839c-54212462967e => generated 288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:45:03.872951 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-6d8d8c0f-abe4-4e36-8307-7279cab67aaf tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Calling method '.version_select at 0x7f29f31f6160>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:04.034899 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-6d8d8c0f-abe4-4e36-8307-7279cab67aaf tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/714e6de3-a5e2-42af-839c-54212462967e" status: 202 len: 0 microversion: 2.1 time: 0.165697 May 12 11:45:04.035926 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 9/23] 10.222.0.58 () {58 vars in 1253 bytes} [Thu May 12 11:45:03 2022] DELETE /compute/v2.1/os-snapshots/714e6de3-a5e2-42af-839c-54212462967e => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:45:04.043890 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-7bf6838f-6a40-4bf7-80ed-454ceb84a8d9 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Calling method '.version_select at 0x7f29f442f820>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:04.086064 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-7bf6838f-6a40-4bf7-80ed-454ceb84a8d9 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/714e6de3-a5e2-42af-839c-54212462967e" status: 200 len: 287 microversion: 2.1 time: 0.046108 May 12 11:45:04.087649 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 15/24] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 12 11:45:04 2022] GET /compute/v2.1/os-snapshots/714e6de3-a5e2-42af-839c-54212462967e => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:45:04.300030 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-abe85c8d-8763-49f6-8e16-2e5d1d8c0259 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:04.300656 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-abe85c8d-8763-49f6-8e16-2e5d1d8c0259 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:04.311216 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-abe85c8d-8763-49f6-8e16-2e5d1d8c0259 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:04.311596 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-abe85c8d-8763-49f6-8e16-2e5d1d8c0259 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:04.312389 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-abe85c8d-8763-49f6-8e16-2e5d1d8c0259 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:04.330000 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-abe85c8d-8763-49f6-8e16-2e5d1d8c0259 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:04.563047 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-abe85c8d-8763-49f6-8e16-2e5d1d8c0259 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5418744ce43cf8074de1d2f0de6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52f1a625344430ba655dc6c40eebb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:04.586891 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-abe85c8d-8763-49f6-8e16-2e5d1d8c0259 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 200 len: 1274 microversion: 2.1 time: 0.290831 May 12 11:45:04.590943 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 10/25] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:04 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 1274 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:04.727824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-f1b047eb-328d-496a-a7b3-d7f41c627812 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Action: 'create', calling method: .version_select at 0x7f29f442f1f0>, body: {"keypair": {"name": "tempest-keypair-1120942243", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdbdhJv/IV4Q5XCrFl6aUgaqKEVguiaP8Xr7wh88t6pJFXBZi56q2qS8gQUls+AcOeoV44RQrMLKLAGLFI1ERyE7PaSICl1nq05Zo3cSmLWZcxFYQknIf9daZPTGdsizg=="}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:45:04.832899 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-f1b047eb-328d-496a-a7b3-d7f41c627812 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Getting quotas for project 079cb1c02174440091d4c5bcbc27bdc5. Resources: {'key_pairs'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:45:04.848541 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-f1b047eb-328d-496a-a7b3-d7f41c627812 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Getting quotas for user 635d1cf64110483b843b01e6e6ddc749 and project 079cb1c02174440091d4c5bcbc27bdc5. Resources: {'key_pairs'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:45:05.002816 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-f1b047eb-328d-496a-a7b3-d7f41c627812 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.641931 May 12 11:45:05.003771 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 16/26] 10.222.0.58 () {62 vars in 1199 bytes} [Thu May 12 11:45:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 644 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 12 11:45:05.103713 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ad74b29d-1905-4c64-ad80-cea3e27f9cf2 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Calling method '.version_select at 0x7f29f31aa550>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:05.145336 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-ad74b29d-1905-4c64-ad80-cea3e27f9cf2 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] HTTP exception thrown: Snapshot 714e6de3-a5e2-42af-839c-54212462967e could not be found. May 12 11:45:05.147726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ad74b29d-1905-4c64-ad80-cea3e27f9cf2 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Request method failure captured: May 12 11:45:05.147726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: GET /compute/v2.1/os-snapshots/714e6de3-a5e2-42af-839c-54212462967e HTTP/1.1 May 12 11:45:05.147726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:45:05.147726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:45:05.147726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:45:05.147726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:45:05.147726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:45:05.147726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:45:05.147726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:45:05.147726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:45:05.147726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPM2eklgGM24hU4RUmTf-zdXLJuUckD0xtEAd3Kc7iaDb1JPMd9ogBhdsuPwsKjrCCRrXZs31YYLJjP_JEfqYhrQlg44qEfwjIR-NrJDrDzJcoEgQ0k8_yn5CPm-DWlT0rL3BKrGd0K8BsJMvqs1uTnueIZqED7UvsDn45cPeKc1LRk May 12 11:45:05.147726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:45:05.147726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:45:05.147726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:45:05.147726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:45:05.147726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:45:05.147726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:45:05.147726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: 4cf6ee1140af40858f19f644ca836290 May 12 11:45:05.147726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1119144134 May 12 11:45:05.147726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:45:05.147726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:45:05.148751 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4cf6ee1140af40858f19f644ca836290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4cf6ee1140af40858f19f644ca836290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4cf6ee1140af40858f19f644ca836290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4cf6ee1140af40858f19f644ca836290", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:45:05.148751 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1119144134 May 12 11:45:05.148751 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: 4cf6ee1140af40858f19f644ca836290 May 12 11:45:05.148751 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1119144134 May 12 11:45:05.148751 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-VolumesSnapshotsTestJSON-1119144134-project May 12 11:45:05.148751 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:45:05.148751 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:45:05.148751 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 5dd78ec10aaf4031968c876c876f489d May 12 11:45:05.148751 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1119144134-project May 12 11:45:05.148751 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: May 12 11:45:05.148751 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Snapshot 714e6de3-a5e2-42af-839c-54212462967e could not be found. May 12 11:45:05.148751 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': '714e6de3-a5e2-42af-839c-54212462967e'} May 12 11:45:05.148751 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:45:05.149839 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:05.149839 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 12 11:45:05.149839 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 12 11:45:05.149839 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 12 11:45:05.149839 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 12 11:45:05.149839 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 12 11:45:05.149839 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 12 11:45:05.149839 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 11:45:05.149839 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 11:45:05.149839 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 11:45:05.149839 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 11:45:05.149839 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 11:45:05.149839 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 11:45:05.149839 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 11:45:05.149839 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 11:45:05.149839 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 714e6de3-a5e2-42af-839c-54212462967e could not be found. (HTTP 404) (Request-ID: req-f6c5d275-f095-4964-bd05-1773fbef5149) May 12 11:45:05.149839 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:05.149839 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:45:05.150704 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:05.150704 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:05.150704 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 12 11:45:05.150704 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 12 11:45:05.150704 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 11:45:05.150704 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 11:45:05.150704 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 12 11:45:05.150704 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 12 11:45:05.150704 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 11:45:05.150704 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 11:45:05.150704 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 12 11:45:05.150704 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 12 11:45:05.150704 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 12 11:45:05.150704 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 12 11:45:05.150704 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 12 11:45:05.150704 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 12 11:45:05.150704 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 11:45:05.150704 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 11:45:05.150704 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 11:45:05.151644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 11:45:05.151644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 11:45:05.151644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 11:45:05.151644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 11:45:05.151644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 11:45:05.151644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 714e6de3-a5e2-42af-839c-54212462967e could not be found. May 12 11:45:05.151644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:05.151644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:45:05.151644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:05.151644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:05.151644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:45:05.151644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:45:05.151644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:45:05.151644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:45:05.151644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 11:45:05.151644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 11:45:05.151644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:45:05.151644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:45:05.151644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 12 11:45:05.151644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:45:05.152552 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 714e6de3-a5e2-42af-839c-54212462967e could not be found. May 12 11:45:05.152552 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:05.152552 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:45:05.152552 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:05.152552 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:05.152552 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:45:05.152552 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:45:05.152552 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:45:05.152552 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:45:05.152552 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 714e6de3-a5e2-42af-839c-54212462967e could not be found. May 12 11:45:05.152552 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:05.152552 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ad74b29d-1905-4c64-ad80-cea3e27f9cf2 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Returning 404 to user: Snapshot 714e6de3-a5e2-42af-839c-54212462967e could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:45:05.152552 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-ad74b29d-1905-4c64-ad80-cea3e27f9cf2 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/714e6de3-a5e2-42af-839c-54212462967e" status: 404 len: 111 microversion: 2.1 time: 0.052358 May 12 11:45:05.153658 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 11/27] 10.222.0.58 () {58 vars in 1250 bytes} [Thu May 12 11:45:05 2022] GET /compute/v2.1/os-snapshots/714e6de3-a5e2-42af-839c-54212462967e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:45:05.171022 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-46299aff-be06-4bc8-ad2f-ef560215b093 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Calling method '.version_select at 0x7f29f437ad30>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:05.345046 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-46299aff-be06-4bc8-ad2f-ef560215b093 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/e2e024cc-e4e5-446c-8364-ed3e6bdb5e95" status: 202 len: 0 microversion: 2.1 time: 0.185752 May 12 11:45:05.345995 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 17/28] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 12 11:45:05 2022] DELETE /compute/v2.1/os-volumes/e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:45:05.354898 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a383b056-aada-4a3d-855a-2157c292c90d tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Calling method '.version_select at 0x7f29f4414790>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:05.472140 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-a383b056-aada-4a3d-855a-2157c292c90d tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/e2e024cc-e4e5-446c-8364-ed3e6bdb5e95" status: 200 len: 345 microversion: 2.1 time: 0.121937 May 12 11:45:05.472901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 12/29] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 12 11:45:05 2022] GET /compute/v2.1/os-volumes/e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 => generated 345 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:45:05.607918 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-05975c06-8a37-40e9-a50a-e022405c13c3 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:05.608927 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-05975c06-8a37-40e9-a50a-e022405c13c3 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:05.661357 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-05975c06-8a37-40e9-a50a-e022405c13c3 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:05.662087 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-05975c06-8a37-40e9-a50a-e022405c13c3 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:05.663078 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-05975c06-8a37-40e9-a50a-e022405c13c3 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:05.664620 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-05975c06-8a37-40e9-a50a-e022405c13c3 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:06.037284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-05975c06-8a37-40e9-a50a-e022405c13c3 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5418744ce43cf8074de1d2f0de6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52f1a625344430ba655dc6c40eebb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:06.063004 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-05975c06-8a37-40e9-a50a-e022405c13c3 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 200 len: 1272 microversion: 2.1 time: 0.459123 May 12 11:45:06.065646 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 18/30] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:05 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 1272 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:06.484971 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-823eaa73-c726-4217-afc9-bb76cd63bc19 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Calling method '.version_select at 0x7f29f31aa940>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:06.576516 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-823eaa73-c726-4217-afc9-bb76cd63bc19 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] HTTP exception thrown: Volume e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 could not be found. May 12 11:45:06.588651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-823eaa73-c726-4217-afc9-bb76cd63bc19 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Request method failure captured: May 12 11:45:06.588651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: GET /compute/v2.1/os-volumes/e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 HTTP/1.1 May 12 11:45:06.588651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:45:06.588651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:45:06.588651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:45:06.588651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:45:06.588651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:45:06.588651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:45:06.588651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:45:06.588651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:45:06.588651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPM2eklgGM24hU4RUmTf-zdXLJuUckD0xtEAd3Kc7iaDb1JPMd9ogBhdsuPwsKjrCCRrXZs31YYLJjP_JEfqYhrQlg44qEfwjIR-NrJDrDzJcoEgQ0k8_yn5CPm-DWlT0rL3BKrGd0K8BsJMvqs1uTnueIZqED7UvsDn45cPeKc1LRk May 12 11:45:06.588651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:45:06.588651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:45:06.588651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:45:06.588651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:45:06.588651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:45:06.588651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:45:06.588651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: 4cf6ee1140af40858f19f644ca836290 May 12 11:45:06.588651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1119144134 May 12 11:45:06.588651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:45:06.588651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:45:06.589761 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4cf6ee1140af40858f19f644ca836290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4cf6ee1140af40858f19f644ca836290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4cf6ee1140af40858f19f644ca836290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4cf6ee1140af40858f19f644ca836290", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:45:06.589761 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1119144134 May 12 11:45:06.589761 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: 4cf6ee1140af40858f19f644ca836290 May 12 11:45:06.589761 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1119144134 May 12 11:45:06.589761 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-VolumesSnapshotsTestJSON-1119144134-project May 12 11:45:06.589761 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:45:06.589761 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:45:06.589761 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 5dd78ec10aaf4031968c876c876f489d May 12 11:45:06.589761 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1119144134-project May 12 11:45:06.589761 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: May 12 11:45:06.589761 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Volume e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 could not be found. May 12 11:45:06.589761 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': 'e2e024cc-e4e5-446c-8364-ed3e6bdb5e95'} May 12 11:45:06.589761 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:45:06.590391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:06.590391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 11:45:06.590391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 11:45:06.590391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 11:45:06.590391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 11:45:06.590391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 11:45:06.590391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 11:45:06.590391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 11:45:06.590391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 11:45:06.590391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 11:45:06.590391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 11:45:06.590391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 11:45:06.590391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 11:45:06.590391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 11:45:06.590391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 11:45:06.590391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 could not be found. (HTTP 404) (Request-ID: req-b10c4693-a034-44c2-ac2c-80ac3cf15dbf) May 12 11:45:06.590391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:06.590391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:45:06.590391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:06.591255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:06.591255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 11:45:06.591255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 11:45:06.591255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 11:45:06.591255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 11:45:06.591255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 11:45:06.591255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 11:45:06.591255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 11:45:06.591255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 11:45:06.591255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 11:45:06.591255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 11:45:06.591255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 11:45:06.591255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 11:45:06.591255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 11:45:06.591255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 11:45:06.591255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 11:45:06.591255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 11:45:06.591255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 11:45:06.591255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 11:45:06.592197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 11:45:06.592197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 11:45:06.592197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 11:45:06.592197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 11:45:06.592197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 could not be found. May 12 11:45:06.592197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:06.592197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:45:06.592197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:06.592197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:06.592197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:45:06.592197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:45:06.592197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:45:06.592197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:45:06.592197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 11:45:06.592197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 11:45:06.592197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:45:06.592197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:45:06.592197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 11:45:06.592197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:45:06.593071 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 could not be found. May 12 11:45:06.593071 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:06.593071 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:45:06.593071 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:06.593071 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:06.593071 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:45:06.593071 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:45:06.593071 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:45:06.593071 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:45:06.593071 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 could not be found. May 12 11:45:06.593071 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:06.593071 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-823eaa73-c726-4217-afc9-bb76cd63bc19 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Returning 404 to user: Volume e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:45:06.593071 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-823eaa73-c726-4217-afc9-bb76cd63bc19 tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/e2e024cc-e4e5-446c-8364-ed3e6bdb5e95" status: 404 len: 109 microversion: 2.1 time: 0.109724 May 12 11:45:06.593071 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 13/31] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 12 11:45:06 2022] GET /compute/v2.1/os-volumes/e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:45:06.601727 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-281d67b3-1998-49fd-af12-53e902f2dc6f tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Calling method '.version_select at 0x7f29f3ad1ca0>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:06.668175 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-281d67b3-1998-49fd-af12-53e902f2dc6f tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] HTTP exception thrown: Volume e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 could not be found. May 12 11:45:06.670500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-281d67b3-1998-49fd-af12-53e902f2dc6f tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Request method failure captured: May 12 11:45:06.670500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: DELETE /compute/v2.1/os-volumes/e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 HTTP/1.1 May 12 11:45:06.670500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:45:06.670500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:45:06.670500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:45:06.670500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 0 May 12 11:45:06.670500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:45:06.670500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:45:06.670500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:45:06.670500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:45:06.670500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPM2eklgGM24hU4RUmTf-zdXLJuUckD0xtEAd3Kc7iaDb1JPMd9ogBhdsuPwsKjrCCRrXZs31YYLJjP_JEfqYhrQlg44qEfwjIR-NrJDrDzJcoEgQ0k8_yn5CPm-DWlT0rL3BKrGd0K8BsJMvqs1uTnueIZqED7UvsDn45cPeKc1LRk May 12 11:45:06.670500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:45:06.670500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:45:06.670500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:45:06.670500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:45:06.670500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:45:06.670500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:45:06.670500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: 4cf6ee1140af40858f19f644ca836290 May 12 11:45:06.670500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1119144134 May 12 11:45:06.670500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:45:06.670500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:45:06.671810 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4cf6ee1140af40858f19f644ca836290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4cf6ee1140af40858f19f644ca836290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4cf6ee1140af40858f19f644ca836290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4cf6ee1140af40858f19f644ca836290", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:45:06.671810 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1119144134 May 12 11:45:06.671810 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: 4cf6ee1140af40858f19f644ca836290 May 12 11:45:06.671810 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1119144134 May 12 11:45:06.671810 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-VolumesSnapshotsTestJSON-1119144134-project May 12 11:45:06.671810 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:45:06.671810 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:45:06.671810 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: 5dd78ec10aaf4031968c876c876f489d May 12 11:45:06.671810 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1119144134-project May 12 11:45:06.671810 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: May 12 11:45:06.671810 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Volume e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 could not be found. May 12 11:45:06.671810 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'id': 'e2e024cc-e4e5-446c-8364-ed3e6bdb5e95'} May 12 11:45:06.671810 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:45:06.672685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:06.672685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 11:45:06.672685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 11:45:06.672685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 11:45:06.672685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 11:45:06.672685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 11:45:06.672685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 11:45:06.672685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 11:45:06.672685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 11:45:06.672685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 11:45:06.672685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 11:45:06.672685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 11:45:06.672685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 11:45:06.672685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 11:45:06.672685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 11:45:06.672685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 could not be found. (HTTP 404) (Request-ID: req-ac9a586a-96a4-4abc-8301-6affab8cf07d) May 12 11:45:06.672685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:45:06.672685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:45:06.672685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:45:06.673568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:06.673568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 11:45:06.673568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 11:45:06.673568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 11:45:06.673568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 11:45:06.673568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 11:45:06.673568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 11:45:06.673568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 11:45:06.673568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 11:45:06.673568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 11:45:06.673568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 11:45:06.673568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 11:45:06.673568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 11:45:06.673568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 11:45:06.673568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 11:45:06.673568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 11:45:06.673568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 11:45:06.673568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 11:45:06.673568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 11:45:06.674598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 11:45:06.674598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 11:45:06.674598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 11:45:06.674598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 11:45:06.674598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 could not be found. May 12 11:45:06.674598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:45:06.674598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:45:06.674598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:45:06.674598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:06.674598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:45:06.674598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:45:06.674598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:45:06.674598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:45:06.674598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 11:45:06.674598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 11:45:06.674598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:45:06.674598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:45:06.674598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 11:45:06.674598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:45:06.675542 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 could not be found. May 12 11:45:06.675542 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:45:06.675542 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:45:06.675542 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:45:06.675542 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:06.675542 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:45:06.675542 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:45:06.675542 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:45:06.675542 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:45:06.675542 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 could not be found. May 12 11:45:06.675542 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:45:06.679027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-281d67b3-1998-49fd-af12-53e902f2dc6f tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Returning 404 to user: Volume e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 could not be found. {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:45:06.681307 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-281d67b3-1998-49fd-af12-53e902f2dc6f tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/e2e024cc-e4e5-446c-8364-ed3e6bdb5e95" status: 404 len: 109 microversion: 2.1 time: 0.082761 May 12 11:45:06.682266 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 19/32] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 12 11:45:06 2022] DELETE /compute/v2.1/os-volumes/e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:45:06.693281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-448d668a-682f-4558-a17b-d62a96e9fabb tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Calling method '.version_select at 0x7f29f31b5b80>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:06.765420 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-448d668a-682f-4558-a17b-d62a96e9fabb tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] HTTP exception thrown: Volume e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 could not be found. May 12 11:45:06.769352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-448d668a-682f-4558-a17b-d62a96e9fabb tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Request method failure captured: May 12 11:45:06.769352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: GET /compute/v2.1/os-volumes/e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 HTTP/1.1 May 12 11:45:06.769352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:45:06.769352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:45:06.769352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:45:06.769352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:45:06.769352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:45:06.769352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:45:06.769352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:45:06.769352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:45:06.769352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPM2eklgGM24hU4RUmTf-zdXLJuUckD0xtEAd3Kc7iaDb1JPMd9ogBhdsuPwsKjrCCRrXZs31YYLJjP_JEfqYhrQlg44qEfwjIR-NrJDrDzJcoEgQ0k8_yn5CPm-DWlT0rL3BKrGd0K8BsJMvqs1uTnueIZqED7UvsDn45cPeKc1LRk May 12 11:45:06.769352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:45:06.769352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:45:06.769352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:45:06.769352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:45:06.769352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:45:06.769352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:45:06.769352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: 4cf6ee1140af40858f19f644ca836290 May 12 11:45:06.769352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1119144134 May 12 11:45:06.769352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:45:06.769352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:45:06.770528 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4cf6ee1140af40858f19f644ca836290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4cf6ee1140af40858f19f644ca836290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4cf6ee1140af40858f19f644ca836290"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4cf6ee1140af40858f19f644ca836290", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:45:06.770528 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1119144134 May 12 11:45:06.770528 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: 4cf6ee1140af40858f19f644ca836290 May 12 11:45:06.770528 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1119144134 May 12 11:45:06.770528 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-VolumesSnapshotsTestJSON-1119144134-project May 12 11:45:06.770528 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:45:06.770528 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:45:06.770528 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 5dd78ec10aaf4031968c876c876f489d May 12 11:45:06.770528 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1119144134-project May 12 11:45:06.770528 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: May 12 11:45:06.770528 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Volume e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 could not be found. May 12 11:45:06.770528 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': 'e2e024cc-e4e5-446c-8364-ed3e6bdb5e95'} May 12 11:45:06.770528 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:45:06.771161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:06.771161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 11:45:06.771161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 11:45:06.771161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 11:45:06.771161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 11:45:06.771161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 11:45:06.771161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 11:45:06.771161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 11:45:06.771161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 11:45:06.771161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 11:45:06.771161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 11:45:06.771161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 11:45:06.771161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 11:45:06.771161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 11:45:06.771161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 11:45:06.771161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 could not be found. (HTTP 404) (Request-ID: req-6e5dcfa6-14ce-4905-9ac2-d1e76a186fbb) May 12 11:45:06.771161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:06.771161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:45:06.771161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:06.772132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:06.772132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 11:45:06.772132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 11:45:06.772132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 11:45:06.772132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 11:45:06.772132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 11:45:06.772132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 11:45:06.772132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 11:45:06.772132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 11:45:06.772132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 11:45:06.772132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 11:45:06.772132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 11:45:06.772132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 11:45:06.772132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 11:45:06.772132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 11:45:06.772132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 11:45:06.772132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 11:45:06.772132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 11:45:06.772132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 11:45:06.782317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 11:45:06.782317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 11:45:06.782317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 11:45:06.782317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 11:45:06.782317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 could not be found. May 12 11:45:06.782317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:06.782317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:45:06.782317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:06.782317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:06.782317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:45:06.782317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:45:06.782317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:45:06.782317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:45:06.782317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 11:45:06.782317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 11:45:06.782317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:45:06.782317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:45:06.782317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 11:45:06.782317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:45:06.784601 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 could not be found. May 12 11:45:06.784601 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:06.784601 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:45:06.784601 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:06.784601 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:06.784601 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:45:06.784601 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:45:06.784601 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:45:06.784601 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:45:06.784601 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 could not be found. May 12 11:45:06.784601 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:06.788429 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-448d668a-682f-4558-a17b-d62a96e9fabb tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] Returning 404 to user: Volume e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:45:06.789551 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-448d668a-682f-4558-a17b-d62a96e9fabb tempest-VolumesSnapshotsTestJSON-1119144134 tempest-VolumesSnapshotsTestJSON-1119144134-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/e2e024cc-e4e5-446c-8364-ed3e6bdb5e95" status: 404 len: 109 microversion: 2.1 time: 0.102237 May 12 11:45:06.790756 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 14/33] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 12 11:45:06 2022] GET /compute/v2.1/os-volumes/e2e024cc-e4e5-446c-8364-ed3e6bdb5e95 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:45:07.081100 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-20bf4d88-a912-41da-8826-fef78bf426fe tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:07.082475 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-20bf4d88-a912-41da-8826-fef78bf426fe tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:07.120033 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-20bf4d88-a912-41da-8826-fef78bf426fe tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:07.142754 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-20bf4d88-a912-41da-8826-fef78bf426fe tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:07.145667 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-20bf4d88-a912-41da-8826-fef78bf426fe tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:07.147997 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-20bf4d88-a912-41da-8826-fef78bf426fe tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:07.550932 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-20bf4d88-a912-41da-8826-fef78bf426fe tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5418744ce43cf8074de1d2f0de6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52f1a625344430ba655dc6c40eebb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:07.573984 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-20bf4d88-a912-41da-8826-fef78bf426fe tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 200 len: 1272 microversion: 2.1 time: 0.494341 May 12 11:45:07.586123 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 20/34] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:07 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 1272 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:08.592921 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b3f5b9f0-d564-4bac-98b2-0c09bf5bcdf2 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:08.595646 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-b3f5b9f0-d564-4bac-98b2-0c09bf5bcdf2 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:08.623693 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b3f5b9f0-d564-4bac-98b2-0c09bf5bcdf2 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:08.624543 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b3f5b9f0-d564-4bac-98b2-0c09bf5bcdf2 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:08.642607 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b3f5b9f0-d564-4bac-98b2-0c09bf5bcdf2 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:08.643404 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b3f5b9f0-d564-4bac-98b2-0c09bf5bcdf2 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:09.356378 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b3f5b9f0-d564-4bac-98b2-0c09bf5bcdf2 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5418744ce43cf8074de1d2f0de6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52f1a625344430ba655dc6c40eebb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:09.368400 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-b3f5b9f0-d564-4bac-98b2-0c09bf5bcdf2 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 200 len: 1314 microversion: 2.1 time: 0.780894 May 12 11:45:09.390215 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 15/35] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:08 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 1314 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:10.392304 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-63529be5-7ec8-4cb3-9dde-cc851ee1e501 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:10.392931 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-63529be5-7ec8-4cb3-9dde-cc851ee1e501 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:10.399639 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-63529be5-7ec8-4cb3-9dde-cc851ee1e501 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:10.400105 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-63529be5-7ec8-4cb3-9dde-cc851ee1e501 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:10.408363 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-63529be5-7ec8-4cb3-9dde-cc851ee1e501 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:10.408958 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-63529be5-7ec8-4cb3-9dde-cc851ee1e501 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:11.295743 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-63529be5-7ec8-4cb3-9dde-cc851ee1e501 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5418744ce43cf8074de1d2f0de6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52f1a625344430ba655dc6c40eebb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:11.314280 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-63529be5-7ec8-4cb3-9dde-cc851ee1e501 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 200 len: 1314 microversion: 2.1 time: 0.923382 May 12 11:45:11.323717 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 21/36] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:10 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 1314 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:12.064971 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-526876ab-55c1-492e-a60c-b3309e01cb56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-404971224", "imageRef": "576e8b7b-771b-47aa-89c6-ff04accc9bea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:45:12.202492 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.network.neutron [None req-526876ab-55c1-492e-a60c-b3309e01cb56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] validate_networks() for [('d9c73724-1128-42dd-9a6f-5e6f5ee490dc', None, None, None, None, None)] {{(pid=123508) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 11:45:12.294535 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-e61f9b61-7d74-488e-9458-1cfd26c50060 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2108199593", "imageRef": "576e8b7b-771b-47aa-89c6-ff04accc9bea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eff33054-22ac-4705-93a5-40677c07e79b"}], "security_groups": [{"name": "tempest-securitygroup--657266016"}], "key_name": "tempest-keypair-1120942243", "user_data": "}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:45:12.723718 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.network.neutron [None req-e61f9b61-7d74-488e-9458-1cfd26c50060 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] validate_networks() for [('eff33054-22ac-4705-93a5-40677c07e79b', None, None, None, None, None)] {{(pid=123507) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 11:45:15.110022 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-e61f9b61-7d74-488e-9458-1cfd26c50060 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Flavor limits 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 11:45:15.111122 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-e61f9b61-7d74-488e-9458-1cfd26c50060 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Image limits 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 11:45:15.111926 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-e61f9b61-7d74-488e-9458-1cfd26c50060 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Flavor pref 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 11:45:15.112515 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-e61f9b61-7d74-488e-9458-1cfd26c50060 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Image pref 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 11:45:15.113095 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-e61f9b61-7d74-488e-9458-1cfd26c50060 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 11:45:15.137770 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e61f9b61-7d74-488e-9458-1cfd26c50060 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:15.150183 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e61f9b61-7d74-488e-9458-1cfd26c50060 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:15.151125 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e61f9b61-7d74-488e-9458-1cfd26c50060 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:15.151720 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e61f9b61-7d74-488e-9458-1cfd26c50060 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:15.244895 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-e61f9b61-7d74-488e-9458-1cfd26c50060 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Getting quotas for project 079cb1c02174440091d4c5bcbc27bdc5. Resources: {'ram', 'cores', 'instances'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:45:15.258300 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-e61f9b61-7d74-488e-9458-1cfd26c50060 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Getting quotas for user 635d1cf64110483b843b01e6e6ddc749 and project 079cb1c02174440091d4c5bcbc27bdc5. Resources: {'ram', 'cores', 'instances'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:45:15.310247 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-e61f9b61-7d74-488e-9458-1cfd26c50060 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Going to run 1 instances... {{(pid=123507) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 11:45:15.314255 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-e61f9b61-7d74-488e-9458-1cfd26c50060 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='576e8b7b-771b-47aa-89c6-ff04accc9bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123507) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 11:45:15.530230 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-e61f9b61-7d74-488e-9458-1cfd26c50060 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.242068 May 12 11:45:15.542266 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 22/37] 10.222.0.58 () {62 vars in 1187 bytes} [Thu May 12 11:45:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 3255 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 12 11:45:15.551378 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-ad095bcc-e76d-428d-8c48-d1658daf85ce tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:15.551463 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-ad095bcc-e76d-428d-8c48-d1658daf85ce tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:15.574084 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ad095bcc-e76d-428d-8c48-d1658daf85ce tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:15.574610 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ad095bcc-e76d-428d-8c48-d1658daf85ce tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:15.575419 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ad095bcc-e76d-428d-8c48-d1658daf85ce tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:15.575912 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ad095bcc-e76d-428d-8c48-d1658daf85ce tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:16.182831 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-ad095bcc-e76d-428d-8c48-d1658daf85ce tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5418744ce43cf8074de1d2f0de6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52f1a625344430ba655dc6c40eebb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:16.200067 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-ad095bcc-e76d-428d-8c48-d1658daf85ce tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 200 len: 1314 microversion: 2.1 time: 0.654951 May 12 11:45:16.204035 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 23/38] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:15 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 1314 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:16.212601 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-e1e0fe48-fdab-4360-9af4-54bfd913b804 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:16.213636 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-e1e0fe48-fdab-4360-9af4-54bfd913b804 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:16.282650 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-526876ab-55c1-492e-a60c-b3309e01cb56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Flavor limits 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 11:45:16.285051 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-526876ab-55c1-492e-a60c-b3309e01cb56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Image limits 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 11:45:16.286109 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-526876ab-55c1-492e-a60c-b3309e01cb56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Flavor pref 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 11:45:16.286733 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-526876ab-55c1-492e-a60c-b3309e01cb56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Image pref 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 11:45:16.287847 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-526876ab-55c1-492e-a60c-b3309e01cb56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 11:45:16.338621 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-526876ab-55c1-492e-a60c-b3309e01cb56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:16.357670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-526876ab-55c1-492e-a60c-b3309e01cb56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:16.362453 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-526876ab-55c1-492e-a60c-b3309e01cb56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:16.366630 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-526876ab-55c1-492e-a60c-b3309e01cb56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:16.395339 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-e1e0fe48-fdab-4360-9af4-54bfd913b804 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:16.428846 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-e1e0fe48-fdab-4360-9af4-54bfd913b804 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:16.436634 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-e1e0fe48-fdab-4360-9af4-54bfd913b804 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:16.440758 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-e1e0fe48-fdab-4360-9af4-54bfd913b804 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1282 microversion: 2.20 time: 0.233859 May 12 11:45:16.442553 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 24/39] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:45:16 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1282 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:45:16.448324 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-526876ab-55c1-492e-a60c-b3309e01cb56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Getting quotas for project dd154e9ddff14089b8fc96ba030e5669. Resources: {'ram', 'cores', 'instances'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:45:16.457513 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-90309a1e-6186-43ae-ad20-9db0e28d043e tempest-VolumesTestJSON-960321636 tempest-VolumesTestJSON-960321636-project] Calling method '.version_select at 0x7f29f39b7ca0>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:16.459750 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-526876ab-55c1-492e-a60c-b3309e01cb56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Getting quotas for user af0e1282e6024c9c8f128a8d7b235733 and project dd154e9ddff14089b8fc96ba030e5669. Resources: {'ram', 'cores', 'instances'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:45:16.499654 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-526876ab-55c1-492e-a60c-b3309e01cb56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Going to run 1 instances... {{(pid=123508) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 11:45:16.503488 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-526876ab-55c1-492e-a60c-b3309e01cb56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='576e8b7b-771b-47aa-89c6-ff04accc9bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 11:45:16.584855 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-90309a1e-6186-43ae-ad20-9db0e28d043e tempest-VolumesTestJSON-960321636 tempest-VolumesTestJSON-960321636-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/10c22d99-e10e-42e1-b619-2441a6c2369b" status: 200 len: 350 microversion: 2.1 time: 0.140481 May 12 11:45:16.586314 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 25/40] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 12 11:45:16 2022] GET /compute/v2.1/os-volumes/10c22d99-e10e-42e1-b619-2441a6c2369b => generated 350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:45:16.649439 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-526876ab-55c1-492e-a60c-b3309e01cb56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.270783 May 12 11:45:16.661783 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 16/41] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 12 11:45:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 5282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 11:45:16.684210 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-e718e7c8-e05a-491f-88e3-2ab26a32d7a4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:16.686310 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-e718e7c8-e05a-491f-88e3-2ab26a32d7a4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:17.307985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-4d6d9f61-f729-41b7-ae14-6a1a37e3b6d0 req-753b6413-0ad9-4986-912d-048630ae33ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ed37963-294c-49b1-a66f-03e5cf54ec97", "tag": "7c309744-6140-4aca-b512-8fb1c111f618"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:45:17.348384 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-4d6d9f61-f729-41b7-ae14-6a1a37e3b6d0 req-753b6413-0ad9-4986-912d-048630ae33ca service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:17.350014 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-4d6d9f61-f729-41b7-ae14-6a1a37e3b6d0 req-753b6413-0ad9-4986-912d-048630ae33ca service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:17.400363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-e718e7c8-e05a-491f-88e3-2ab26a32d7a4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:17.416929 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-e718e7c8-e05a-491f-88e3-2ab26a32d7a4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1221 microversion: 2.1 time: 0.753653 May 12 11:45:17.418527 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 17/42] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:16 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1221 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:17.432562 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-0668b820-82d7-4954-8620-a24f5d9fccc9 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:17.433962 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-0668b820-82d7-4954-8620-a24f5d9fccc9 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:17.472313 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-4d6d9f61-f729-41b7-ae14-6a1a37e3b6d0 req-753b6413-0ad9-4986-912d-048630ae33ca service nova] Creating event network-changed:7c309744-6140-4aca-b512-8fb1c111f618 for instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 on hv-cinder-80473 May 12 11:45:17.474436 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-4d6d9f61-f729-41b7-ae14-6a1a37e3b6d0 req-753b6413-0ad9-4986-912d-048630ae33ca service nova] Acquired lock "compute-rpcapi-router" {{(pid=123507) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 12 11:45:17.479185 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8837e76b-09d3-442e-b39f-c4ea610267d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:17.482179 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8837e76b-09d3-442e-b39f-c4ea610267d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:17.486696 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8837e76b-09d3-442e-b39f-c4ea610267d8 None None] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:17.488736 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8837e76b-09d3-442e-b39f-c4ea610267d8 None None] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:17.493218 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0668b820-82d7-4954-8620-a24f5d9fccc9 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:17.493723 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0668b820-82d7-4954-8620-a24f5d9fccc9 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:17.505550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0668b820-82d7-4954-8620-a24f5d9fccc9 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:17.505725 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0668b820-82d7-4954-8620-a24f5d9fccc9 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:17.525202 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.compute.rpcapi [None req-8837e76b-09d3-442e-b39f-c4ea610267d8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 12 11:45:17.528113 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8837e76b-09d3-442e-b39f-c4ea610267d8 None None] Releasing lock "compute-rpcapi-router" {{(pid=123507) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 12 11:45:17.589131 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-8837e76b-09d3-442e-b39f-c4ea610267d8 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.001335 May 12 11:45:17.590298 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 26/43] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:45:17.596262 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-0ee91776-6ff5-4be1-a557-1316f87b496c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:17.613137 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-0ee91776-6ff5-4be1-a557-1316f87b496c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:17.843954 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-0ee91776-6ff5-4be1-a557-1316f87b496c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:17.859882 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-0ee91776-6ff5-4be1-a557-1316f87b496c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:17.865136 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-0ee91776-6ff5-4be1-a557-1316f87b496c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:17.868471 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-0ee91776-6ff5-4be1-a557-1316f87b496c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1282 microversion: 2.20 time: 0.275572 May 12 11:45:17.881651 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 27/44] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:45:17 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1282 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:45:17.933307 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-13f7aad5-ed29-4ccd-8343-5751d44ec191 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-408168304", "imageRef": "576e8b7b-771b-47aa-89c6-ff04accc9bea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:45:18.057057 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.network.neutron [None req-13f7aad5-ed29-4ccd-8343-5751d44ec191 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] validate_networks() for [('d9c73724-1128-42dd-9a6f-5e6f5ee490dc', None, None, None, None, None)] {{(pid=123507) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 11:45:19.373426 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-0668b820-82d7-4954-8620-a24f5d9fccc9 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5418744ce43cf8074de1d2f0de6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52f1a625344430ba655dc6c40eebb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:19.382598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-13f7aad5-ed29-4ccd-8343-5751d44ec191 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Flavor limits 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 11:45:19.383477 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-13f7aad5-ed29-4ccd-8343-5751d44ec191 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Image limits 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 11:45:19.384370 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-13f7aad5-ed29-4ccd-8343-5751d44ec191 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Flavor pref 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 11:45:19.385157 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-13f7aad5-ed29-4ccd-8343-5751d44ec191 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Image pref 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 11:45:19.385982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-13f7aad5-ed29-4ccd-8343-5751d44ec191 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 11:45:19.400303 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-0668b820-82d7-4954-8620-a24f5d9fccc9 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 200 len: 1314 microversion: 2.1 time: 1.978245 May 12 11:45:19.401650 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 18/45] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:17 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 1314 bytes in 1982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:19.416232 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-13f7aad5-ed29-4ccd-8343-5751d44ec191 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:19.417017 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-13f7aad5-ed29-4ccd-8343-5751d44ec191 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:19.418197 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-13f7aad5-ed29-4ccd-8343-5751d44ec191 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:19.419012 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-13f7aad5-ed29-4ccd-8343-5751d44ec191 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:19.421322 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-7594e3fd-dccf-4488-8f0a-4e43cc7fe085 tempest-VolumesTestJSON-960321636 tempest-VolumesTestJSON-960321636-project] Calling method '.version_select at 0x7f29f31b5790>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:19.466851 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-13f7aad5-ed29-4ccd-8343-5751d44ec191 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Getting quotas for project dd154e9ddff14089b8fc96ba030e5669. Resources: {'ram', 'cores', 'instances'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:45:19.497379 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-13f7aad5-ed29-4ccd-8343-5751d44ec191 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Getting quotas for user af0e1282e6024c9c8f128a8d7b235733 and project dd154e9ddff14089b8fc96ba030e5669. Resources: {'ram', 'cores', 'instances'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:45:19.523106 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-7594e3fd-dccf-4488-8f0a-4e43cc7fe085 tempest-VolumesTestJSON-960321636 tempest-VolumesTestJSON-960321636-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/958b7b24-daeb-4762-af17-d3adc236b3b6" status: 200 len: 351 microversion: 2.1 time: 0.119416 May 12 11:45:19.530508 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 19/46] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 12 11:45:19 2022] GET /compute/v2.1/os-volumes/958b7b24-daeb-4762-af17-d3adc236b3b6 => generated 351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:45:19.535960 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-3486e58b-1950-453e-95cb-f6e4e43a713e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:19.537313 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-3486e58b-1950-453e-95cb-f6e4e43a713e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:19.546494 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3486e58b-1950-453e-95cb-f6e4e43a713e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:19.546783 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3486e58b-1950-453e-95cb-f6e4e43a713e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:19.547686 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3486e58b-1950-453e-95cb-f6e4e43a713e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:19.548433 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3486e58b-1950-453e-95cb-f6e4e43a713e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:19.548549 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-13f7aad5-ed29-4ccd-8343-5751d44ec191 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Going to run 1 instances... {{(pid=123507) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 11:45:19.558341 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-13f7aad5-ed29-4ccd-8343-5751d44ec191 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='576e8b7b-771b-47aa-89c6-ff04accc9bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123507) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 11:45:19.679187 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-3486e58b-1950-453e-95cb-f6e4e43a713e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:19.696647 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-13f7aad5-ed29-4ccd-8343-5751d44ec191 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.775612 May 12 11:45:19.696828 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-3486e58b-1950-453e-95cb-f6e4e43a713e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:19.698039 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-3486e58b-1950-453e-95cb-f6e4e43a713e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:19.699368 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-3486e58b-1950-453e-95cb-f6e4e43a713e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1334 microversion: 2.20 time: 0.167729 May 12 11:45:19.700562 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 20/47] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:45:19 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1334 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:45:19.704953 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 28/48] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 12 11:45:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 11:45:19.719711 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-aef7068c-ad12-49f3-9eb1-a97f29500f2d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:19.720925 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-aef7068c-ad12-49f3-9eb1-a97f29500f2d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:19.923715 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-aef7068c-ad12-49f3-9eb1-a97f29500f2d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:19.932995 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-aef7068c-ad12-49f3-9eb1-a97f29500f2d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1221 microversion: 2.1 time: 0.217619 May 12 11:45:19.933620 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 21/49] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:19 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1221 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:20.425785 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-71eb8e41-c1a8-4de1-a4ff-adc02a07155e tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:20.426574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-71eb8e41-c1a8-4de1-a4ff-adc02a07155e tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:20.460125 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-71eb8e41-c1a8-4de1-a4ff-adc02a07155e tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:20.464726 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-71eb8e41-c1a8-4de1-a4ff-adc02a07155e tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:20.468266 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-71eb8e41-c1a8-4de1-a4ff-adc02a07155e tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:20.472101 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-71eb8e41-c1a8-4de1-a4ff-adc02a07155e tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:20.720993 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-9357d1ce-98ad-4b9b-93d7-6516f4dafc26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:20.723057 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-9357d1ce-98ad-4b9b-93d7-6516f4dafc26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:20.731969 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9357d1ce-98ad-4b9b-93d7-6516f4dafc26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:20.733967 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9357d1ce-98ad-4b9b-93d7-6516f4dafc26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:20.735041 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9357d1ce-98ad-4b9b-93d7-6516f4dafc26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:20.735715 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9357d1ce-98ad-4b9b-93d7-6516f4dafc26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:20.806793 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-9357d1ce-98ad-4b9b-93d7-6516f4dafc26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:20.815620 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-9357d1ce-98ad-4b9b-93d7-6516f4dafc26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:20.817147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-9357d1ce-98ad-4b9b-93d7-6516f4dafc26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:20.818297 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-9357d1ce-98ad-4b9b-93d7-6516f4dafc26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1334 microversion: 2.20 time: 0.103357 May 12 11:45:20.818915 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 22/50] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:45:20 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1334 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:45:20.950929 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-1bbd7a68-75ab-4d49-8226-10c2b2c0aef2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:20.952128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-1bbd7a68-75ab-4d49-8226-10c2b2c0aef2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:20.962639 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1bbd7a68-75ab-4d49-8226-10c2b2c0aef2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:20.963421 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1bbd7a68-75ab-4d49-8226-10c2b2c0aef2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:20.964425 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1bbd7a68-75ab-4d49-8226-10c2b2c0aef2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:20.965074 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1bbd7a68-75ab-4d49-8226-10c2b2c0aef2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:21.057789 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-71eb8e41-c1a8-4de1-a4ff-adc02a07155e tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5418744ce43cf8074de1d2f0de6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52f1a625344430ba655dc6c40eebb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:21.070103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-71eb8e41-c1a8-4de1-a4ff-adc02a07155e tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 200 len: 1314 microversion: 2.1 time: 0.653993 May 12 11:45:21.070927 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 29/51] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:20 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 1314 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:21.174562 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-1bbd7a68-75ab-4d49-8226-10c2b2c0aef2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:21.182788 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-1bbd7a68-75ab-4d49-8226-10c2b2c0aef2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1225 microversion: 2.1 time: 0.235924 May 12 11:45:21.192695 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 23/52] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:20 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1225 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:45:21.315737 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-3dcde9d3-25b3-4998-b28c-b565e90e6c7f tempest-VolumesTestJSON-960321636 tempest-VolumesTestJSON-960321636-project] Calling method '.version_select at 0x7f29f39d0ee0>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:21.419644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-3dcde9d3-25b3-4998-b28c-b565e90e6c7f tempest-VolumesTestJSON-960321636 tempest-VolumesTestJSON-960321636-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/8034b082-203c-4e09-8fd9-54f7fc05e952" status: 200 len: 351 microversion: 2.1 time: 0.109072 May 12 11:45:21.420391 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 30/53] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 12 11:45:21 2022] GET /compute/v2.1/os-volumes/8034b082-203c-4e09-8fd9-54f7fc05e952 => generated 351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:45:21.435137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-95faa881-563f-445b-ba53-c811acefcc88 tempest-VolumesTestJSON-960321636 tempest-VolumesTestJSON-960321636-project] Calling method '.version_select at 0x7f29f31b50d0>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:21.538864 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-95faa881-563f-445b-ba53-c811acefcc88 tempest-VolumesTestJSON-960321636 tempest-VolumesTestJSON-960321636-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.110690 May 12 11:45:21.539527 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 24/54] 10.222.0.58 () {58 vars in 1133 bytes} [Thu May 12 11:45:21 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:21.553200 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-63974a79-1c1d-4f99-8ffe-8c8290bed6f3 tempest-VolumesTestJSON-960321636 tempest-VolumesTestJSON-960321636-project] Calling method '.version_select at 0x7f29f39d08b0>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:21.705237 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-63974a79-1c1d-4f99-8ffe-8c8290bed6f3 tempest-VolumesTestJSON-960321636 tempest-VolumesTestJSON-960321636-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.155946 May 12 11:45:21.706097 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 31/55] 10.222.0.58 () {58 vars in 1148 bytes} [Thu May 12 11:45:21 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:45:21.718635 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-9ffb9549-363f-40f9-9f86-5d6bb5859594 tempest-VolumesTestJSON-960321636 tempest-VolumesTestJSON-960321636-project] Calling method '.version_select at 0x7f29f31cb310>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:21.810007 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-9ffb9549-363f-40f9-9f86-5d6bb5859594 tempest-VolumesTestJSON-960321636 tempest-VolumesTestJSON-960321636-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.095234 May 12 11:45:21.818786 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 25/56] 10.222.0.58 () {58 vars in 1133 bytes} [Thu May 12 11:45:21 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:21.823051 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-0e56d77a-a190-4ab9-9d77-9dac1cb614b4 tempest-VolumesTestJSON-960321636 tempest-VolumesTestJSON-960321636-project] Calling method '.version_select at 0x7f29f2974a60>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:21.836435 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-6868e37e-070a-4b02-882a-360f1cdb52a2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:21.837165 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-6868e37e-070a-4b02-882a-360f1cdb52a2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:21.846642 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6868e37e-070a-4b02-882a-360f1cdb52a2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:21.850260 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6868e37e-070a-4b02-882a-360f1cdb52a2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:21.851215 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6868e37e-070a-4b02-882a-360f1cdb52a2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:21.851734 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6868e37e-070a-4b02-882a-360f1cdb52a2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:21.971282 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-6868e37e-070a-4b02-882a-360f1cdb52a2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:21.978115 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-0e56d77a-a190-4ab9-9d77-9dac1cb614b4 tempest-VolumesTestJSON-960321636 tempest-VolumesTestJSON-960321636-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.158308 May 12 11:45:21.979164 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 32/57] 10.222.0.58 () {58 vars in 1166 bytes} [Thu May 12 11:45:21 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:45:21.981171 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-6868e37e-070a-4b02-882a-360f1cdb52a2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:21.982661 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-6868e37e-070a-4b02-882a-360f1cdb52a2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:21.984816 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-6868e37e-070a-4b02-882a-360f1cdb52a2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1342 microversion: 2.20 time: 0.151406 May 12 11:45:21.985827 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 26/58] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:45:21 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1342 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:45:21.996643 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-c1968c02-caa6-487c-846d-759c50265cb7 tempest-VolumesTestJSON-960321636 tempest-VolumesTestJSON-960321636-project] Calling method '.version_select at 0x7f29f2974c10>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:22.086846 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-0534da58-7f16-4843-b6af-43ee0858555a tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:22.087567 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-0534da58-7f16-4843-b6af-43ee0858555a tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:22.097111 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0534da58-7f16-4843-b6af-43ee0858555a tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:22.097763 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0534da58-7f16-4843-b6af-43ee0858555a tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:22.099348 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0534da58-7f16-4843-b6af-43ee0858555a tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:22.100700 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0534da58-7f16-4843-b6af-43ee0858555a tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:22.128741 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-c1968c02-caa6-487c-846d-759c50265cb7 tempest-VolumesTestJSON-960321636 tempest-VolumesTestJSON-960321636-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.137551 May 12 11:45:22.129481 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 33/59] 10.222.0.58 () {58 vars in 1169 bytes} [Thu May 12 11:45:21 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:45:22.141180 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-bd427647-5e9c-4576-9168-769ab3d8bb78 tempest-VolumesTestJSON-960321636 tempest-VolumesTestJSON-960321636-project] Calling method '.version_select at 0x7f29f3a321f0>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:22.262651 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-bd427647-5e9c-4576-9168-769ab3d8bb78 tempest-VolumesTestJSON-960321636 tempest-VolumesTestJSON-960321636-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.125212 May 12 11:45:22.263209 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 34/60] 10.222.0.58 () {58 vars in 1154 bytes} [Thu May 12 11:45:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:45:22.274760 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-0aed627b-958b-4be2-b987-f432511c1a56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:22.275734 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-0aed627b-958b-4be2-b987-f432511c1a56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:22.307892 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0aed627b-958b-4be2-b987-f432511c1a56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:22.308351 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0aed627b-958b-4be2-b987-f432511c1a56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:22.309152 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0aed627b-958b-4be2-b987-f432511c1a56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:22.309598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0aed627b-958b-4be2-b987-f432511c1a56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:22.533685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-0aed627b-958b-4be2-b987-f432511c1a56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:22.541288 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-0aed627b-958b-4be2-b987-f432511c1a56 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1217 microversion: 2.1 time: 0.276793 May 12 11:45:22.545642 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 35/61] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:22 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1217 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:22.551014 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-b2bac2f0-2e93-4faf-babc-b4c912e7c47c tempest-VolumesTestJSON-960321636 tempest-VolumesTestJSON-960321636-project] Calling method '.version_select at 0x7f29f39d0670>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:22.634759 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-0534da58-7f16-4843-b6af-43ee0858555a tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5418744ce43cf8074de1d2f0de6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52f1a625344430ba655dc6c40eebb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:22.642689 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-0534da58-7f16-4843-b6af-43ee0858555a tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 200 len: 1314 microversion: 2.1 time: 0.560134 May 12 11:45:22.652117 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 27/62] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:22 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:22.709129 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-b2bac2f0-2e93-4faf-babc-b4c912e7c47c tempest-VolumesTestJSON-960321636 tempest-VolumesTestJSON-960321636-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.161572 May 12 11:45:22.710575 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 36/63] 10.222.0.58 () {58 vars in 1187 bytes} [Thu May 12 11:45:22 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:45:22.722930 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-08b8c695-425c-4f48-a651-82efa23de694 tempest-VolumesTestJSON-960321636 tempest-VolumesTestJSON-960321636-project] Calling method '.version_select at 0x7f29f31cb8b0>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:22.834310 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-08b8c695-425c-4f48-a651-82efa23de694 tempest-VolumesTestJSON-960321636 tempest-VolumesTestJSON-960321636-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.116166 May 12 11:45:22.834929 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 28/64] 10.222.0.58 () {58 vars in 1154 bytes} [Thu May 12 11:45:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:23.003310 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-cdbc002d-7b4c-4c4c-a7e5-e26c71cd8fa9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:23.004377 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-cdbc002d-7b4c-4c4c-a7e5-e26c71cd8fa9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:23.011437 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cdbc002d-7b4c-4c4c-a7e5-e26c71cd8fa9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:23.012018 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cdbc002d-7b4c-4c4c-a7e5-e26c71cd8fa9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:23.013046 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cdbc002d-7b4c-4c4c-a7e5-e26c71cd8fa9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:23.013628 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cdbc002d-7b4c-4c4c-a7e5-e26c71cd8fa9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:23.095938 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-cdbc002d-7b4c-4c4c-a7e5-e26c71cd8fa9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:23.111598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-cdbc002d-7b4c-4c4c-a7e5-e26c71cd8fa9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:23.114394 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-cdbc002d-7b4c-4c4c-a7e5-e26c71cd8fa9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:23.116540 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-cdbc002d-7b4c-4c4c-a7e5-e26c71cd8fa9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1340 microversion: 2.20 time: 0.117495 May 12 11:45:23.118028 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 37/65] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:45:22 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1340 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:45:23.562127 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-f02fbab9-c42f-4288-85b3-34365ce8a561 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:23.563080 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-f02fbab9-c42f-4288-85b3-34365ce8a561 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:23.573472 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f02fbab9-c42f-4288-85b3-34365ce8a561 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:23.575825 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f02fbab9-c42f-4288-85b3-34365ce8a561 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:23.584953 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f02fbab9-c42f-4288-85b3-34365ce8a561 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:23.585678 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f02fbab9-c42f-4288-85b3-34365ce8a561 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:23.666517 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-3542ff20-986d-4187-a949-669e79a0dace tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:23.667465 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-3542ff20-986d-4187-a949-669e79a0dace tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:23.678798 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3542ff20-986d-4187-a949-669e79a0dace tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:23.679944 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3542ff20-986d-4187-a949-669e79a0dace tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:23.680982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3542ff20-986d-4187-a949-669e79a0dace tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:23.683130 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3542ff20-986d-4187-a949-669e79a0dace tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:23.790836 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-f02fbab9-c42f-4288-85b3-34365ce8a561 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:23.816032 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-f02fbab9-c42f-4288-85b3-34365ce8a561 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1291 microversion: 2.1 time: 0.257789 May 12 11:45:23.817875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 29/66] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:23 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1291 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:24.136254 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-dede2f85-f90f-49ee-8c83-ac5a35dc0113 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:24.137508 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-dede2f85-f90f-49ee-8c83-ac5a35dc0113 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:24.152538 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dede2f85-f90f-49ee-8c83-ac5a35dc0113 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:24.153216 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dede2f85-f90f-49ee-8c83-ac5a35dc0113 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:24.156486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dede2f85-f90f-49ee-8c83-ac5a35dc0113 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:24.157148 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dede2f85-f90f-49ee-8c83-ac5a35dc0113 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:24.193011 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-3542ff20-986d-4187-a949-669e79a0dace tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5418744ce43cf8074de1d2f0de6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52f1a625344430ba655dc6c40eebb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:24.201303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-3542ff20-986d-4187-a949-669e79a0dace tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 200 len: 1314 microversion: 2.1 time: 0.539447 May 12 11:45:24.204403 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 38/67] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:23 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:24.337426 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-dede2f85-f90f-49ee-8c83-ac5a35dc0113 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:24.345328 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-dede2f85-f90f-49ee-8c83-ac5a35dc0113 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:24.361174 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-dede2f85-f90f-49ee-8c83-ac5a35dc0113 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:24.362879 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-dede2f85-f90f-49ee-8c83-ac5a35dc0113 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1340 microversion: 2.20 time: 0.230800 May 12 11:45:24.364365 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 30/68] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:45:24 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1340 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:45:24.835796 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-d4b92748-9370-4b8f-965d-238b20c59719 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:24.835796 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d4b92748-9370-4b8f-965d-238b20c59719 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:24.841771 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d4b92748-9370-4b8f-965d-238b20c59719 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:24.842599 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d4b92748-9370-4b8f-965d-238b20c59719 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:24.843634 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d4b92748-9370-4b8f-965d-238b20c59719 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:24.844291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d4b92748-9370-4b8f-965d-238b20c59719 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:25.120251 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-d4b92748-9370-4b8f-965d-238b20c59719 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:25.132245 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-d4b92748-9370-4b8f-965d-238b20c59719 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1279 microversion: 2.1 time: 0.301584 May 12 11:45:25.133695 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 39/69] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:24 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1279 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:25.222346 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a551e0d5-91fa-43e8-b444-5d133883967b tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:25.223055 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-a551e0d5-91fa-43e8-b444-5d133883967b tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:25.236909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a551e0d5-91fa-43e8-b444-5d133883967b tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:25.239688 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a551e0d5-91fa-43e8-b444-5d133883967b tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:25.240836 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a551e0d5-91fa-43e8-b444-5d133883967b tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:25.243523 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a551e0d5-91fa-43e8-b444-5d133883967b tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:25.383349 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-9ac76362-3ac8-4ce9-9db6-eb4ebd7cb125 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:25.383890 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-9ac76362-3ac8-4ce9-9db6-eb4ebd7cb125 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:25.394109 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9ac76362-3ac8-4ce9-9db6-eb4ebd7cb125 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:25.394574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9ac76362-3ac8-4ce9-9db6-eb4ebd7cb125 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:25.395364 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9ac76362-3ac8-4ce9-9db6-eb4ebd7cb125 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:25.398475 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9ac76362-3ac8-4ce9-9db6-eb4ebd7cb125 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:25.463316 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-a551e0d5-91fa-43e8-b444-5d133883967b tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5418744ce43cf8074de1d2f0de6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52f1a625344430ba655dc6c40eebb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:25.481684 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-a551e0d5-91fa-43e8-b444-5d133883967b tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 200 len: 1314 microversion: 2.1 time: 0.258587 May 12 11:45:25.482349 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 31/70] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:25 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:25.743210 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-9ac76362-3ac8-4ce9-9db6-eb4ebd7cb125 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:25.759694 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-9ac76362-3ac8-4ce9-9db6-eb4ebd7cb125 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:25.762340 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-9ac76362-3ac8-4ce9-9db6-eb4ebd7cb125 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:25.764146 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-9ac76362-3ac8-4ce9-9db6-eb4ebd7cb125 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1407 microversion: 2.20 time: 0.386874 May 12 11:45:25.766902 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 40/71] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:45:25 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1407 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:45:26.105411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-4f814a56-a97f-42be-b788-5698eb082372 req-4bf474b1-83e1-4afc-bec2-8c50e347bcfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ed37963-294c-49b1-a66f-03e5cf54ec97", "name": "network-vif-plugged", "status": "completed", "tag": "7c309744-6140-4aca-b512-8fb1c111f618"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:45:26.138698 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-4f814a56-a97f-42be-b788-5698eb082372 req-4bf474b1-83e1-4afc-bec2-8c50e347bcfd service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:26.139136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-4f814a56-a97f-42be-b788-5698eb082372 req-4bf474b1-83e1-4afc-bec2-8c50e347bcfd service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:26.151019 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-49aa612d-2af4-4c53-bcf4-0bf7da569514 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:26.152737 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-49aa612d-2af4-4c53-bcf4-0bf7da569514 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:26.163060 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-49aa612d-2af4-4c53-bcf4-0bf7da569514 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:26.166421 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-49aa612d-2af4-4c53-bcf4-0bf7da569514 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:26.167565 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-49aa612d-2af4-4c53-bcf4-0bf7da569514 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:26.168686 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-49aa612d-2af4-4c53-bcf4-0bf7da569514 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:26.201502 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-4f814a56-a97f-42be-b788-5698eb082372 req-4bf474b1-83e1-4afc-bec2-8c50e347bcfd service nova] Creating event network-vif-plugged:7c309744-6140-4aca-b512-8fb1c111f618 for instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 on hv-cinder-80473 May 12 11:45:26.210299 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-4f814a56-a97f-42be-b788-5698eb082372 req-4bf474b1-83e1-4afc-bec2-8c50e347bcfd service nova] Acquired lock "compute-rpcapi-router" {{(pid=123508) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 12 11:45:26.211738 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-930cb1ce-2568-4a82-8c7a-d4978a1967c8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:26.212329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-930cb1ce-2568-4a82-8c7a-d4978a1967c8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:26.213266 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-930cb1ce-2568-4a82-8c7a-d4978a1967c8 None None] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:26.213868 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-930cb1ce-2568-4a82-8c7a-d4978a1967c8 None None] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:26.236557 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.compute.rpcapi [None req-930cb1ce-2568-4a82-8c7a-d4978a1967c8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 12 11:45:26.238139 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-930cb1ce-2568-4a82-8c7a-d4978a1967c8 None None] Releasing lock "compute-rpcapi-router" {{(pid=123508) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 12 11:45:26.272929 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-930cb1ce-2568-4a82-8c7a-d4978a1967c8 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.460935 May 12 11:45:26.273793 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 32/72] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:45:26.499838 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-85119f25-5fe9-4d4f-808d-4efcd0a70d88 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:26.500665 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-85119f25-5fe9-4d4f-808d-4efcd0a70d88 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:26.518589 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-85119f25-5fe9-4d4f-808d-4efcd0a70d88 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:26.530618 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-85119f25-5fe9-4d4f-808d-4efcd0a70d88 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:26.531692 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-85119f25-5fe9-4d4f-808d-4efcd0a70d88 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:26.532341 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-85119f25-5fe9-4d4f-808d-4efcd0a70d88 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:26.864956 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-49aa612d-2af4-4c53-bcf4-0bf7da569514 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:26.878059 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-49aa612d-2af4-4c53-bcf4-0bf7da569514 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1321 microversion: 2.1 time: 0.731331 May 12 11:45:26.879292 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 41/73] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:26 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1321 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:26.885299 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-41572fe2-78de-4113-955b-9fa2cdf789b9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:26.886436 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-41572fe2-78de-4113-955b-9fa2cdf789b9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:26.932505 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-41572fe2-78de-4113-955b-9fa2cdf789b9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:26.937300 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-41572fe2-78de-4113-955b-9fa2cdf789b9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:26.938510 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-41572fe2-78de-4113-955b-9fa2cdf789b9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:26.942027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-41572fe2-78de-4113-955b-9fa2cdf789b9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:27.171213 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-85119f25-5fe9-4d4f-808d-4efcd0a70d88 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5418744ce43cf8074de1d2f0de6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52f1a625344430ba655dc6c40eebb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:27.187681 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-85119f25-5fe9-4d4f-808d-4efcd0a70d88 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 200 len: 1314 microversion: 2.1 time: 0.690004 May 12 11:45:27.191041 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 33/74] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:26 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 1314 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:27.214057 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-132007ae-36e7-417d-9a47-6b95d7e43bb2 req-b9916a82-424c-4c7a-baef-172a1214acc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337fca44-29a2-43fd-bc5f-092ad95c83f8", "tag": "17fde922-0d37-4159-bb44-fb31f42dc415"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:45:27.244870 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-132007ae-36e7-417d-9a47-6b95d7e43bb2 req-b9916a82-424c-4c7a-baef-172a1214acc2 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:27.245513 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-132007ae-36e7-417d-9a47-6b95d7e43bb2 req-b9916a82-424c-4c7a-baef-172a1214acc2 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:27.287994 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-132007ae-36e7-417d-9a47-6b95d7e43bb2 req-b9916a82-424c-4c7a-baef-172a1214acc2 service nova] Creating event network-changed:17fde922-0d37-4159-bb44-fb31f42dc415 for instance 337fca44-29a2-43fd-bc5f-092ad95c83f8 on hv-cinder-80473 May 12 11:45:27.302017 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-132007ae-36e7-417d-9a47-6b95d7e43bb2 req-b9916a82-424c-4c7a-baef-172a1214acc2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108001 May 12 11:45:27.303940 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 34/75] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:45:27.628681 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-41572fe2-78de-4113-955b-9fa2cdf789b9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:27.642296 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-41572fe2-78de-4113-955b-9fa2cdf789b9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:27.643833 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-41572fe2-78de-4113-955b-9fa2cdf789b9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:27.646008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-41572fe2-78de-4113-955b-9fa2cdf789b9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1407 microversion: 2.20 time: 0.764704 May 12 11:45:27.658827 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 42/76] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:45:26 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1407 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:45:27.896302 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-cacd4e41-cba4-400e-bd4a-ed2ef2ebd219 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:27.897257 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-cacd4e41-cba4-400e-bd4a-ed2ef2ebd219 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:27.903884 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cacd4e41-cba4-400e-bd4a-ed2ef2ebd219 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:27.904627 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cacd4e41-cba4-400e-bd4a-ed2ef2ebd219 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:27.906395 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cacd4e41-cba4-400e-bd4a-ed2ef2ebd219 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:27.907195 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cacd4e41-cba4-400e-bd4a-ed2ef2ebd219 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:28.206730 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-9932ff6f-a25d-4eb2-96e8-c4579e875f1e tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:28.207506 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-9932ff6f-a25d-4eb2-96e8-c4579e875f1e tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:28.219782 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9932ff6f-a25d-4eb2-96e8-c4579e875f1e tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:28.220320 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9932ff6f-a25d-4eb2-96e8-c4579e875f1e tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:28.225081 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9932ff6f-a25d-4eb2-96e8-c4579e875f1e tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:28.225552 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9932ff6f-a25d-4eb2-96e8-c4579e875f1e tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:28.308522 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-cacd4e41-cba4-400e-bd4a-ed2ef2ebd219 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:28.319738 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-cacd4e41-cba4-400e-bd4a-ed2ef2ebd219 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1321 microversion: 2.1 time: 0.427466 May 12 11:45:28.320763 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 35/77] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:27 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1321 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:28.425072 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-270d76b4-ba55-43dc-ad0c-63e9e5dd7e1f req-406e9c87-59f7-4394-8b7a-5e389f33ecc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5cd2aad-2374-4ded-8b72-2e54fbbad916", "tag": "d3632d97-f0ea-41b4-9003-a50ffebf91df"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:45:28.444066 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-270d76b4-ba55-43dc-ad0c-63e9e5dd7e1f req-406e9c87-59f7-4394-8b7a-5e389f33ecc4 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:28.444533 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-270d76b4-ba55-43dc-ad0c-63e9e5dd7e1f req-406e9c87-59f7-4394-8b7a-5e389f33ecc4 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:28.464378 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-270d76b4-ba55-43dc-ad0c-63e9e5dd7e1f req-406e9c87-59f7-4394-8b7a-5e389f33ecc4 service nova] Creating event network-changed:d3632d97-f0ea-41b4-9003-a50ffebf91df for instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 on hv-cinder-80473 May 12 11:45:28.476601 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-270d76b4-ba55-43dc-ad0c-63e9e5dd7e1f req-406e9c87-59f7-4394-8b7a-5e389f33ecc4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154258 May 12 11:45:28.477591 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 36/78] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:45:28.667554 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-cda2308e-c9ff-42e1-a514-cd127efeb0f5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:28.671477 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-cda2308e-c9ff-42e1-a514-cd127efeb0f5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:28.680495 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cda2308e-c9ff-42e1-a514-cd127efeb0f5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:28.680969 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cda2308e-c9ff-42e1-a514-cd127efeb0f5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:28.681984 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cda2308e-c9ff-42e1-a514-cd127efeb0f5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:28.682567 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cda2308e-c9ff-42e1-a514-cd127efeb0f5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:28.712513 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-9932ff6f-a25d-4eb2-96e8-c4579e875f1e tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5418744ce43cf8074de1d2f0de6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52f1a625344430ba655dc6c40eebb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:28.720996 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-9932ff6f-a25d-4eb2-96e8-c4579e875f1e tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 200 len: 1314 microversion: 2.1 time: 0.518743 May 12 11:45:28.731068 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 43/79] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:28 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:45:28.993154 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-cda2308e-c9ff-42e1-a514-cd127efeb0f5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:29.010412 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-cda2308e-c9ff-42e1-a514-cd127efeb0f5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:29.014380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-cda2308e-c9ff-42e1-a514-cd127efeb0f5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:29.018212 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-cda2308e-c9ff-42e1-a514-cd127efeb0f5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1407 microversion: 2.20 time: 0.357408 May 12 11:45:29.030395 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 37/80] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:45:28 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1407 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:45:29.339553 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-9b7b01c0-da50-4eaf-8412-7cbdaf626f10 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:29.340327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-9b7b01c0-da50-4eaf-8412-7cbdaf626f10 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:29.348414 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9b7b01c0-da50-4eaf-8412-7cbdaf626f10 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:29.348794 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9b7b01c0-da50-4eaf-8412-7cbdaf626f10 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:29.349573 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9b7b01c0-da50-4eaf-8412-7cbdaf626f10 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:29.350040 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9b7b01c0-da50-4eaf-8412-7cbdaf626f10 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:29.633466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-9b7b01c0-da50-4eaf-8412-7cbdaf626f10 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:29.664389 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-9b7b01c0-da50-4eaf-8412-7cbdaf626f10 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1321 microversion: 2.1 time: 0.330569 May 12 11:45:29.674265 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 44/81] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:29 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1321 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:29.738060 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-43b0e3bb-092a-4f3b-bcc3-53f95999e7b8 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:29.739429 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-43b0e3bb-092a-4f3b-bcc3-53f95999e7b8 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:29.750420 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-43b0e3bb-092a-4f3b-bcc3-53f95999e7b8 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:29.754212 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-43b0e3bb-092a-4f3b-bcc3-53f95999e7b8 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:29.755070 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-43b0e3bb-092a-4f3b-bcc3-53f95999e7b8 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:29.755526 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-43b0e3bb-092a-4f3b-bcc3-53f95999e7b8 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:29.992612 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-43b0e3bb-092a-4f3b-bcc3-53f95999e7b8 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5418744ce43cf8074de1d2f0de6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52f1a625344430ba655dc6c40eebb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:30.000602 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-43b0e3bb-092a-4f3b-bcc3-53f95999e7b8 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 200 len: 1314 microversion: 2.1 time: 0.267079 May 12 11:45:30.001165 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 38/82] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:29 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:30.036569 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-0faab44c-47d4-4166-b136-5f6a6e51abb7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:30.037466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-0faab44c-47d4-4166-b136-5f6a6e51abb7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:30.044382 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0faab44c-47d4-4166-b136-5f6a6e51abb7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:30.045017 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0faab44c-47d4-4166-b136-5f6a6e51abb7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:30.045953 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0faab44c-47d4-4166-b136-5f6a6e51abb7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:30.046529 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0faab44c-47d4-4166-b136-5f6a6e51abb7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:30.510079 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-f0423e07-cac1-40ea-ae08-77f290126360 req-6d165752-984b-4cff-9d33-c4893732f002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5be16749-99b5-4f22-b115-cccceb984ce2", "tag": "d8954dff-d153-4c3d-ad72-4aa8eef966c2"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:45:30.523067 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-f0423e07-cac1-40ea-ae08-77f290126360 req-6d165752-984b-4cff-9d33-c4893732f002 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:30.526055 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-f0423e07-cac1-40ea-ae08-77f290126360 req-6d165752-984b-4cff-9d33-c4893732f002 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:30.547055 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-f0423e07-cac1-40ea-ae08-77f290126360 req-6d165752-984b-4cff-9d33-c4893732f002 service nova] Creating event network-changed:d8954dff-d153-4c3d-ad72-4aa8eef966c2 for instance 5be16749-99b5-4f22-b115-cccceb984ce2 on hv-cinder-80473 May 12 11:45:30.563754 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-f0423e07-cac1-40ea-ae08-77f290126360 req-6d165752-984b-4cff-9d33-c4893732f002 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057746 May 12 11:45:30.564962 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 39/83] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:45:30.653607 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-0faab44c-47d4-4166-b136-5f6a6e51abb7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:30.668119 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-0faab44c-47d4-4166-b136-5f6a6e51abb7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:30.678611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-0faab44c-47d4-4166-b136-5f6a6e51abb7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:30.681086 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-4c13f024-0558-4fed-9a4e-04c8ddd517b2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:30.681922 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-0faab44c-47d4-4166-b136-5f6a6e51abb7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1407 microversion: 2.20 time: 0.648689 May 12 11:45:30.682190 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-4c13f024-0558-4fed-9a4e-04c8ddd517b2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:30.685583 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 45/84] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:45:30 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1407 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:45:30.701081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4c13f024-0558-4fed-9a4e-04c8ddd517b2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:30.701619 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4c13f024-0558-4fed-9a4e-04c8ddd517b2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:30.702705 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4c13f024-0558-4fed-9a4e-04c8ddd517b2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:30.703165 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4c13f024-0558-4fed-9a4e-04c8ddd517b2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:30.954794 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-4c13f024-0558-4fed-9a4e-04c8ddd517b2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:30.974551 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-4c13f024-0558-4fed-9a4e-04c8ddd517b2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1321 microversion: 2.1 time: 0.293134 May 12 11:45:30.977466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 40/85] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:30 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:45:31.023237 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-6ead7f2b-5194-4737-86f3-8f4824719171 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:31.024065 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-6ead7f2b-5194-4737-86f3-8f4824719171 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:31.035869 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6ead7f2b-5194-4737-86f3-8f4824719171 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:31.038893 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6ead7f2b-5194-4737-86f3-8f4824719171 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:31.040768 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6ead7f2b-5194-4737-86f3-8f4824719171 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:31.042265 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6ead7f2b-5194-4737-86f3-8f4824719171 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:31.424917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-6ead7f2b-5194-4737-86f3-8f4824719171 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5418744ce43cf8074de1d2f0de6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52f1a625344430ba655dc6c40eebb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:31.432311 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-6ead7f2b-5194-4737-86f3-8f4824719171 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 200 len: 1501 microversion: 2.1 time: 0.419285 May 12 11:45:31.437397 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 46/86] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:31 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 1501 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:31.702769 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b6f6416d-e133-4432-9f41-9da3ee1f4f86 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:31.703697 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-b6f6416d-e133-4432-9f41-9da3ee1f4f86 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:31.710289 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b6f6416d-e133-4432-9f41-9da3ee1f4f86 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:31.711177 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b6f6416d-e133-4432-9f41-9da3ee1f4f86 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:31.712379 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b6f6416d-e133-4432-9f41-9da3ee1f4f86 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:31.712944 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b6f6416d-e133-4432-9f41-9da3ee1f4f86 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:31.890258 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b6f6416d-e133-4432-9f41-9da3ee1f4f86 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:31.903341 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b6f6416d-e133-4432-9f41-9da3ee1f4f86 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:31.905890 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b6f6416d-e133-4432-9f41-9da3ee1f4f86 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:31.907266 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-b6f6416d-e133-4432-9f41-9da3ee1f4f86 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1407 microversion: 2.20 time: 0.208490 May 12 11:45:31.908167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 41/87] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:45:31 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:45:31.995468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-7d2366e4-8b3e-415d-9f3a-cabdf27d34b3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:31.996031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-7d2366e4-8b3e-415d-9f3a-cabdf27d34b3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:32.002423 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7d2366e4-8b3e-415d-9f3a-cabdf27d34b3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:32.003094 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7d2366e4-8b3e-415d-9f3a-cabdf27d34b3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:32.004513 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7d2366e4-8b3e-415d-9f3a-cabdf27d34b3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:32.005125 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7d2366e4-8b3e-415d-9f3a-cabdf27d34b3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:32.212671 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-7d2366e4-8b3e-415d-9f3a-cabdf27d34b3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:32.220377 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-7d2366e4-8b3e-415d-9f3a-cabdf27d34b3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1321 microversion: 2.1 time: 0.228631 May 12 11:45:32.221278 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 47/88] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:31 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:32.925416 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a53538f1-832f-4951-93c0-03e8174d8e3f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:32.926060 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-a53538f1-832f-4951-93c0-03e8174d8e3f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:32.932093 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a53538f1-832f-4951-93c0-03e8174d8e3f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:32.932547 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a53538f1-832f-4951-93c0-03e8174d8e3f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:32.933492 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a53538f1-832f-4951-93c0-03e8174d8e3f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:32.933972 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a53538f1-832f-4951-93c0-03e8174d8e3f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:33.091525 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-a53538f1-832f-4951-93c0-03e8174d8e3f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:33.100163 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-a53538f1-832f-4951-93c0-03e8174d8e3f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:33.101687 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-a53538f1-832f-4951-93c0-03e8174d8e3f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:33.102812 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-a53538f1-832f-4951-93c0-03e8174d8e3f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1407 microversion: 2.20 time: 0.181932 May 12 11:45:33.103374 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 42/89] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:45:32 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:45:33.239534 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-2dc1602f-00f9-462e-b3a8-c3e22df97a00 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:33.240159 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-2dc1602f-00f9-462e-b3a8-c3e22df97a00 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:33.247162 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2dc1602f-00f9-462e-b3a8-c3e22df97a00 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:33.248209 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2dc1602f-00f9-462e-b3a8-c3e22df97a00 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:33.249636 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2dc1602f-00f9-462e-b3a8-c3e22df97a00 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:33.250219 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2dc1602f-00f9-462e-b3a8-c3e22df97a00 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:33.403276 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-2dc1602f-00f9-462e-b3a8-c3e22df97a00 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:33.410596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-2dc1602f-00f9-462e-b3a8-c3e22df97a00 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1321 microversion: 2.1 time: 0.175465 May 12 11:45:33.411174 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 48/90] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:33 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:34.120683 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-484323a5-0c6a-4be9-8961-4f105d935653 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:34.121291 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-484323a5-0c6a-4be9-8961-4f105d935653 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:34.127044 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-484323a5-0c6a-4be9-8961-4f105d935653 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:34.127492 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-484323a5-0c6a-4be9-8961-4f105d935653 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:34.128257 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-484323a5-0c6a-4be9-8961-4f105d935653 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:34.128729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-484323a5-0c6a-4be9-8961-4f105d935653 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:34.258258 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-484323a5-0c6a-4be9-8961-4f105d935653 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:34.266749 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-484323a5-0c6a-4be9-8961-4f105d935653 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:34.268261 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-484323a5-0c6a-4be9-8961-4f105d935653 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:34.269373 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-484323a5-0c6a-4be9-8961-4f105d935653 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1407 microversion: 2.20 time: 0.152487 May 12 11:45:34.269941 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 43/91] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:45:34 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:45:34.428107 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-3b5bd688-1d8f-44f3-8d02-41602a1263f6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:34.428800 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-3b5bd688-1d8f-44f3-8d02-41602a1263f6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:34.434718 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3b5bd688-1d8f-44f3-8d02-41602a1263f6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:34.435396 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3b5bd688-1d8f-44f3-8d02-41602a1263f6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:34.436165 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3b5bd688-1d8f-44f3-8d02-41602a1263f6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:34.436603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3b5bd688-1d8f-44f3-8d02-41602a1263f6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:34.589619 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-3b5bd688-1d8f-44f3-8d02-41602a1263f6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:34.599963 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-3b5bd688-1d8f-44f3-8d02-41602a1263f6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1321 microversion: 2.1 time: 0.175216 May 12 11:45:34.601036 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 49/92] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:34 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:35.287174 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-70d4d9dc-e09b-434b-be3c-fecb5170e61e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:35.287967 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-70d4d9dc-e09b-434b-be3c-fecb5170e61e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:35.294069 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-70d4d9dc-e09b-434b-be3c-fecb5170e61e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:35.294522 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-70d4d9dc-e09b-434b-be3c-fecb5170e61e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:35.295947 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-70d4d9dc-e09b-434b-be3c-fecb5170e61e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:35.296391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-70d4d9dc-e09b-434b-be3c-fecb5170e61e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:35.366260 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-3d1fb724-1a2e-4e52-9199-23ad16b155e1 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be75c4cb-039b-4863-b9fa-bbec33ac983a"}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:45:35.367635 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-3d1fb724-1a2e-4e52-9199-23ad16b155e1 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:35.375815 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3d1fb724-1a2e-4e52-9199-23ad16b155e1 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:35.376711 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3d1fb724-1a2e-4e52-9199-23ad16b155e1 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:35.377662 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3d1fb724-1a2e-4e52-9199-23ad16b155e1 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:35.378425 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3d1fb724-1a2e-4e52-9199-23ad16b155e1 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:35.535262 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-70d4d9dc-e09b-434b-be3c-fecb5170e61e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:35.549310 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-70d4d9dc-e09b-434b-be3c-fecb5170e61e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:35.559407 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-70d4d9dc-e09b-434b-be3c-fecb5170e61e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:35.561233 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-70d4d9dc-e09b-434b-be3c-fecb5170e61e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1407 microversion: 2.20 time: 0.277479 May 12 11:45:35.565867 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 44/93] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:45:35 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1407 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:45:35.631754 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a9a3b7d1-3d3c-41cc-8ab5-ba882a36d251 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:35.632928 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-a9a3b7d1-3d3c-41cc-8ab5-ba882a36d251 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:35.641403 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a9a3b7d1-3d3c-41cc-8ab5-ba882a36d251 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:35.642086 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a9a3b7d1-3d3c-41cc-8ab5-ba882a36d251 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:35.643042 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a9a3b7d1-3d3c-41cc-8ab5-ba882a36d251 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:35.643824 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a9a3b7d1-3d3c-41cc-8ab5-ba882a36d251 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:35.883752 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-3d1fb724-1a2e-4e52-9199-23ad16b155e1 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "POST /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.521524 May 12 11:45:35.890359 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 50/94] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 12 11:45:35 2022] POST /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97/os-volume_attachments => generated 194 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:45:35.890918 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-a9a3b7d1-3d3c-41cc-8ab5-ba882a36d251 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:35.899563 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-a9a3b7d1-3d3c-41cc-8ab5-ba882a36d251 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1321 microversion: 2.1 time: 0.284793 May 12 11:45:35.910412 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 45/95] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:35 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:36.585362 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-127792f1-567f-4cd3-b538-e617bb91c44b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:36.585920 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-127792f1-567f-4cd3-b538-e617bb91c44b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:36.594637 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-127792f1-567f-4cd3-b538-e617bb91c44b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:36.595260 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-127792f1-567f-4cd3-b538-e617bb91c44b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:36.596241 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-127792f1-567f-4cd3-b538-e617bb91c44b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:36.596990 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-127792f1-567f-4cd3-b538-e617bb91c44b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:36.768044 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-8f1a35fc-4ebe-4252-be89-b718bb25074c req-1465862a-baa4-40e7-b178-ffbf96510157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337fca44-29a2-43fd-bc5f-092ad95c83f8", "name": "network-vif-plugged", "status": "completed", "tag": "17fde922-0d37-4159-bb44-fb31f42dc415"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:45:36.786196 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-8f1a35fc-4ebe-4252-be89-b718bb25074c req-1465862a-baa4-40e7-b178-ffbf96510157 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:36.786918 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-8f1a35fc-4ebe-4252-be89-b718bb25074c req-1465862a-baa4-40e7-b178-ffbf96510157 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:36.812987 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-8f1a35fc-4ebe-4252-be89-b718bb25074c req-1465862a-baa4-40e7-b178-ffbf96510157 service nova] Creating event network-vif-plugged:17fde922-0d37-4159-bb44-fb31f42dc415 for instance 337fca44-29a2-43fd-bc5f-092ad95c83f8 on hv-cinder-80473 May 12 11:45:36.837540 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-8f1a35fc-4ebe-4252-be89-b718bb25074c req-1465862a-baa4-40e7-b178-ffbf96510157 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075703 May 12 11:45:36.840200 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 46/96] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:45:36.874184 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-127792f1-567f-4cd3-b538-e617bb91c44b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:36.884955 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-127792f1-567f-4cd3-b538-e617bb91c44b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:36.886731 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-127792f1-567f-4cd3-b538-e617bb91c44b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:36.889635 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-127792f1-567f-4cd3-b538-e617bb91c44b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1407 microversion: 2.20 time: 0.309828 May 12 11:45:36.901749 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 51/97] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:45:36 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1407 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:45:36.920264 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-60df8f35-7fcb-4f6f-95f3-47c0aa4ca20a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:36.921427 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-60df8f35-7fcb-4f6f-95f3-47c0aa4ca20a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:36.933437 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-60df8f35-7fcb-4f6f-95f3-47c0aa4ca20a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:36.934436 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-60df8f35-7fcb-4f6f-95f3-47c0aa4ca20a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:36.935300 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-60df8f35-7fcb-4f6f-95f3-47c0aa4ca20a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:36.936547 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-60df8f35-7fcb-4f6f-95f3-47c0aa4ca20a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:37.196874 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-60df8f35-7fcb-4f6f-95f3-47c0aa4ca20a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:37.206576 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-60df8f35-7fcb-4f6f-95f3-47c0aa4ca20a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1321 microversion: 2.1 time: 0.293352 May 12 11:45:37.207338 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 47/98] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:36 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:37.910332 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-85e0e5ee-0bc6-4aef-b043-b42a4519f07b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:37.910994 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-85e0e5ee-0bc6-4aef-b043-b42a4519f07b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:37.922594 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-85e0e5ee-0bc6-4aef-b043-b42a4519f07b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:37.933857 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-85e0e5ee-0bc6-4aef-b043-b42a4519f07b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:37.933986 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-85e0e5ee-0bc6-4aef-b043-b42a4519f07b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:37.946905 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-85e0e5ee-0bc6-4aef-b043-b42a4519f07b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:38.221408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-85e0e5ee-0bc6-4aef-b043-b42a4519f07b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:38.224596 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-fc4cdefd-1c37-466a-9388-c6cd21690b39 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:38.225866 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-fc4cdefd-1c37-466a-9388-c6cd21690b39 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:38.233593 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-85e0e5ee-0bc6-4aef-b043-b42a4519f07b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:38.235417 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fc4cdefd-1c37-466a-9388-c6cd21690b39 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:38.235823 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-85e0e5ee-0bc6-4aef-b043-b42a4519f07b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:38.235964 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fc4cdefd-1c37-466a-9388-c6cd21690b39 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:38.237480 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-85e0e5ee-0bc6-4aef-b043-b42a4519f07b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1407 microversion: 2.20 time: 0.331616 May 12 11:45:38.238253 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 52/99] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:45:37 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:45:38.238909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fc4cdefd-1c37-466a-9388-c6cd21690b39 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:38.239481 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fc4cdefd-1c37-466a-9388-c6cd21690b39 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:38.434394 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-fc4cdefd-1c37-466a-9388-c6cd21690b39 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:38.444149 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-fc4cdefd-1c37-466a-9388-c6cd21690b39 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1321 microversion: 2.1 time: 0.224404 May 12 11:45:38.454379 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 48/100] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:38 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:39.257661 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-66cd71d9-4882-4647-a5b4-2f625532e906 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:39.258870 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-66cd71d9-4882-4647-a5b4-2f625532e906 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:39.272829 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-66cd71d9-4882-4647-a5b4-2f625532e906 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:39.273977 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-66cd71d9-4882-4647-a5b4-2f625532e906 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:39.274777 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-66cd71d9-4882-4647-a5b4-2f625532e906 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:39.275220 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-66cd71d9-4882-4647-a5b4-2f625532e906 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:39.462982 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-87830fee-e4c2-44dc-a363-d347e9dc9eec tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:39.463803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-87830fee-e4c2-44dc-a363-d347e9dc9eec tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:39.477164 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-87830fee-e4c2-44dc-a363-d347e9dc9eec tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:39.477731 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-87830fee-e4c2-44dc-a363-d347e9dc9eec tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:39.479789 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-87830fee-e4c2-44dc-a363-d347e9dc9eec tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:39.481296 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-87830fee-e4c2-44dc-a363-d347e9dc9eec tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:39.523871 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-66cd71d9-4882-4647-a5b4-2f625532e906 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:39.536946 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-66cd71d9-4882-4647-a5b4-2f625532e906 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:39.539523 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-66cd71d9-4882-4647-a5b4-2f625532e906 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:39.540922 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-66cd71d9-4882-4647-a5b4-2f625532e906 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1407 microversion: 2.20 time: 0.288210 May 12 11:45:39.544582 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 53/101] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:45:39 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1407 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:45:39.669276 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-6a2ac79b-30df-4b9f-8d27-f7b59e58cf24 req-e0fce54e-1dda-46f4-aa2d-182398c7eb47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be16749-99b5-4f22-b115-cccceb984ce2", "name": "network-vif-plugged", "status": "completed", "tag": "d8954dff-d153-4c3d-ad72-4aa8eef966c2"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:45:39.684783 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-6a2ac79b-30df-4b9f-8d27-f7b59e58cf24 req-e0fce54e-1dda-46f4-aa2d-182398c7eb47 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:39.685236 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-6a2ac79b-30df-4b9f-8d27-f7b59e58cf24 req-e0fce54e-1dda-46f4-aa2d-182398c7eb47 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:39.716529 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-6a2ac79b-30df-4b9f-8d27-f7b59e58cf24 req-e0fce54e-1dda-46f4-aa2d-182398c7eb47 service nova] Creating event network-vif-plugged:d8954dff-d153-4c3d-ad72-4aa8eef966c2 for instance 5be16749-99b5-4f22-b115-cccceb984ce2 on hv-cinder-80473 May 12 11:45:39.729983 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-6a2ac79b-30df-4b9f-8d27-f7b59e58cf24 req-e0fce54e-1dda-46f4-aa2d-182398c7eb47 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064598 May 12 11:45:39.731923 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 54/102] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:45:39.784889 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-87830fee-e4c2-44dc-a363-d347e9dc9eec tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:39.796633 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-87830fee-e4c2-44dc-a363-d347e9dc9eec tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1321 microversion: 2.1 time: 0.337409 May 12 11:45:39.808551 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 49/103] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:39 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:45:40.562132 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-13d38ddf-517b-49e7-af95-3e80ed845d48 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:40.563528 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-13d38ddf-517b-49e7-af95-3e80ed845d48 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:40.579391 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-13d38ddf-517b-49e7-af95-3e80ed845d48 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:40.579984 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-13d38ddf-517b-49e7-af95-3e80ed845d48 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:40.580855 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-13d38ddf-517b-49e7-af95-3e80ed845d48 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:40.581637 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-13d38ddf-517b-49e7-af95-3e80ed845d48 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:40.751248 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-13d38ddf-517b-49e7-af95-3e80ed845d48 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:40.760746 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-13d38ddf-517b-49e7-af95-3e80ed845d48 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:40.762294 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-13d38ddf-517b-49e7-af95-3e80ed845d48 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:40.764224 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-13d38ddf-517b-49e7-af95-3e80ed845d48 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1407 microversion: 2.20 time: 0.206797 May 12 11:45:40.765029 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 55/104] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:45:40 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:45:40.814048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-23eb8120-84c0-4e33-a8a9-7de988975150 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:40.814667 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-23eb8120-84c0-4e33-a8a9-7de988975150 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:40.820518 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-23eb8120-84c0-4e33-a8a9-7de988975150 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:40.820970 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-23eb8120-84c0-4e33-a8a9-7de988975150 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:40.821950 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-23eb8120-84c0-4e33-a8a9-7de988975150 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:40.822570 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-23eb8120-84c0-4e33-a8a9-7de988975150 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:40.960660 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-23eb8120-84c0-4e33-a8a9-7de988975150 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:40.969105 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-23eb8120-84c0-4e33-a8a9-7de988975150 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1321 microversion: 2.1 time: 0.159579 May 12 11:45:40.978419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 50/105] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:40 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:41.781951 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-9bbdfcc3-2fd7-4e66-af02-a12076de519d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:41.782713 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-9bbdfcc3-2fd7-4e66-af02-a12076de519d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:41.788907 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9bbdfcc3-2fd7-4e66-af02-a12076de519d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:41.789530 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9bbdfcc3-2fd7-4e66-af02-a12076de519d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:41.790398 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9bbdfcc3-2fd7-4e66-af02-a12076de519d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:41.790936 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9bbdfcc3-2fd7-4e66-af02-a12076de519d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:41.811238 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-05166b3b-c5b1-4c4c-9d65-46cd7af25473 req-3457d6f6-f60a-4397-9d8e-80b0b49ab873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5cd2aad-2374-4ded-8b72-2e54fbbad916", "name": "network-vif-plugged", "status": "completed", "tag": "d3632d97-f0ea-41b4-9003-a50ffebf91df"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:45:41.822071 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-05166b3b-c5b1-4c4c-9d65-46cd7af25473 req-3457d6f6-f60a-4397-9d8e-80b0b49ab873 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:41.823320 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-05166b3b-c5b1-4c4c-9d65-46cd7af25473 req-3457d6f6-f60a-4397-9d8e-80b0b49ab873 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:41.842090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-05166b3b-c5b1-4c4c-9d65-46cd7af25473 req-3457d6f6-f60a-4397-9d8e-80b0b49ab873 service nova] Creating event network-vif-plugged:d3632d97-f0ea-41b4-9003-a50ffebf91df for instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 on hv-cinder-80473 May 12 11:45:41.858442 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-05166b3b-c5b1-4c4c-9d65-46cd7af25473 req-3457d6f6-f60a-4397-9d8e-80b0b49ab873 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052693 May 12 11:45:41.864910 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 51/106] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:45:41.988433 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-964cbede-ab51-4e73-afc7-4f46e3b2c203 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:41.989441 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-964cbede-ab51-4e73-afc7-4f46e3b2c203 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:42.005467 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-9bbdfcc3-2fd7-4e66-af02-a12076de519d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:42.008753 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-964cbede-ab51-4e73-afc7-4f46e3b2c203 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:42.013228 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-964cbede-ab51-4e73-afc7-4f46e3b2c203 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:42.015277 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-964cbede-ab51-4e73-afc7-4f46e3b2c203 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:42.016262 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-964cbede-ab51-4e73-afc7-4f46e3b2c203 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:42.017126 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-9bbdfcc3-2fd7-4e66-af02-a12076de519d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:42.018641 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-9bbdfcc3-2fd7-4e66-af02-a12076de519d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:42.019794 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-9bbdfcc3-2fd7-4e66-af02-a12076de519d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1407 microversion: 2.20 time: 0.241831 May 12 11:45:42.020348 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 56/107] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:45:41 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:45:42.242070 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-964cbede-ab51-4e73-afc7-4f46e3b2c203 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:42.256163 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-964cbede-ab51-4e73-afc7-4f46e3b2c203 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1515 microversion: 2.1 time: 0.273435 May 12 11:45:42.256846 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 52/108] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:41 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1515 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:42.279211 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-7e82020f-6830-4888-8f4d-31379bd61b31 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:45:42.280902 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-7e82020f-6830-4888-8f4d-31379bd61b31 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:42.287876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7e82020f-6830-4888-8f4d-31379bd61b31 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:42.288330 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7e82020f-6830-4888-8f4d-31379bd61b31 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:42.289120 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7e82020f-6830-4888-8f4d-31379bd61b31 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:42.296101 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7e82020f-6830-4888-8f4d-31379bd61b31 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:42.343291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.objects.instance [None req-7e82020f-6830-4888-8f4d-31379bd61b31 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lazy-loading 'flavor' on Instance uuid 5be16749-99b5-4f22-b115-cccceb984ce2 {{(pid=123507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:45:42.489058 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-7e82020f-6830-4888-8f4d-31379bd61b31 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "POST /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2/action" status: 200 len: 32 microversion: 2.1 time: 0.214508 May 12 11:45:42.490343 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 57/109] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 12 11:45:42 2022] POST /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2/action => generated 32 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 11:45:42.510075 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-6ec8d266-e99a-44e9-a685-e0ad1a7a03c5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:42.510075 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-6ec8d266-e99a-44e9-a685-e0ad1a7a03c5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:42.513061 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6ec8d266-e99a-44e9-a685-e0ad1a7a03c5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:42.513742 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6ec8d266-e99a-44e9-a685-e0ad1a7a03c5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:42.514539 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6ec8d266-e99a-44e9-a685-e0ad1a7a03c5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:42.515200 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6ec8d266-e99a-44e9-a685-e0ad1a7a03c5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:42.678096 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-6ec8d266-e99a-44e9-a685-e0ad1a7a03c5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:42.689468 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-6ec8d266-e99a-44e9-a685-e0ad1a7a03c5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.190493 May 12 11:45:42.689468 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 53/110] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:42 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:43.044995 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-9f1fe3f4-592a-437a-843d-99c3c826db71 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:43.046101 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-9f1fe3f4-592a-437a-843d-99c3c826db71 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:43.052514 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9f1fe3f4-592a-437a-843d-99c3c826db71 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:43.052982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9f1fe3f4-592a-437a-843d-99c3c826db71 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:43.053812 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9f1fe3f4-592a-437a-843d-99c3c826db71 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:43.054351 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9f1fe3f4-592a-437a-843d-99c3c826db71 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:43.204326 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-9f1fe3f4-592a-437a-843d-99c3c826db71 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:43.215153 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-9f1fe3f4-592a-437a-843d-99c3c826db71 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:43.216858 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-9f1fe3f4-592a-437a-843d-99c3c826db71 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:43.218421 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-9f1fe3f4-592a-437a-843d-99c3c826db71 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1407 microversion: 2.20 time: 0.181961 May 12 11:45:43.219132 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 58/111] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:45:43 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:45:43.711952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-c62c5005-aa41-43d5-a822-b8c5192204de tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:43.712776 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-c62c5005-aa41-43d5-a822-b8c5192204de tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:43.724229 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c62c5005-aa41-43d5-a822-b8c5192204de tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:43.724682 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c62c5005-aa41-43d5-a822-b8c5192204de tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:43.725629 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c62c5005-aa41-43d5-a822-b8c5192204de tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:43.726094 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c62c5005-aa41-43d5-a822-b8c5192204de tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:43.911630 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c62c5005-aa41-43d5-a822-b8c5192204de tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:43.923662 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-c62c5005-aa41-43d5-a822-b8c5192204de tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.219073 May 12 11:45:43.925127 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 54/112] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:43 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:44.231639 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-0bfce837-12c4-429a-843f-db7a4456fe90 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1885069608", "imageRef": "576e8b7b-771b-47aa-89c6-ff04accc9bea", "flavorRef": "452"}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:45:44.243266 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-f625a346-c661-4646-9539-eab416ca395c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:44.243992 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-f625a346-c661-4646-9539-eab416ca395c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:44.255379 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f625a346-c661-4646-9539-eab416ca395c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:44.257343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f625a346-c661-4646-9539-eab416ca395c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:44.258930 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f625a346-c661-4646-9539-eab416ca395c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:44.260278 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f625a346-c661-4646-9539-eab416ca395c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:44.306445 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.network.neutron [None req-0bfce837-12c4-429a-843f-db7a4456fe90 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] validate_networks() for None {{(pid=123507) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 11:45:44.461215 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-f625a346-c661-4646-9539-eab416ca395c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:44.480287 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-f625a346-c661-4646-9539-eab416ca395c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:44.486203 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-f625a346-c661-4646-9539-eab416ca395c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:44.490314 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-f625a346-c661-4646-9539-eab416ca395c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1407 microversion: 2.20 time: 0.252631 May 12 11:45:44.491410 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 55/113] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:45:44 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:45:44.834626 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-0bfce837-12c4-429a-843f-db7a4456fe90 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Flavor limits 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 11:45:44.835062 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-0bfce837-12c4-429a-843f-db7a4456fe90 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Image limits 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 11:45:44.835541 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-0bfce837-12c4-429a-843f-db7a4456fe90 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Flavor pref 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 11:45:44.835957 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-0bfce837-12c4-429a-843f-db7a4456fe90 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Image pref 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 11:45:44.836374 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-0bfce837-12c4-429a-843f-db7a4456fe90 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 11:45:44.846073 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0bfce837-12c4-429a-843f-db7a4456fe90 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:44.846580 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0bfce837-12c4-429a-843f-db7a4456fe90 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:44.847462 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0bfce837-12c4-429a-843f-db7a4456fe90 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:44.847878 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0bfce837-12c4-429a-843f-db7a4456fe90 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:44.866715 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-0bfce837-12c4-429a-843f-db7a4456fe90 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Getting quotas for project 27c66c53d7c443749ee12d9c6478a8e3. Resources: {'ram', 'cores', 'instances'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:45:44.870922 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-0bfce837-12c4-429a-843f-db7a4456fe90 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Getting quotas for user a29a589c1141436ba4c052ceff48a99f and project 27c66c53d7c443749ee12d9c6478a8e3. Resources: {'ram', 'cores', 'instances'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:45:44.882411 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-0bfce837-12c4-429a-843f-db7a4456fe90 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Going to run 1 instances... {{(pid=123507) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 11:45:44.884757 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-0bfce837-12c4-429a-843f-db7a4456fe90 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] [instance: 0a996f51-8f4d-4537-a941-aa692ff88bf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='576e8b7b-771b-47aa-89c6-ff04accc9bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123507) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 11:45:44.946087 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-1c91ec6c-7c80-4e64-bec7-3ddbee2e9041 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:44.947309 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-1c91ec6c-7c80-4e64-bec7-3ddbee2e9041 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:44.955668 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1c91ec6c-7c80-4e64-bec7-3ddbee2e9041 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:44.956408 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1c91ec6c-7c80-4e64-bec7-3ddbee2e9041 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:44.957430 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1c91ec6c-7c80-4e64-bec7-3ddbee2e9041 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:44.958104 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1c91ec6c-7c80-4e64-bec7-3ddbee2e9041 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:44.987290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-0bfce837-12c4-429a-843f-db7a4456fe90 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760471 May 12 11:45:44.989252 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 59/114] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 12 11:45:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 11:45:45.002264 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-f7afbee3-3328-4dc2-850c-c3cca5767a40 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:45.002439 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-f7afbee3-3328-4dc2-850c-c3cca5767a40 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] [instance: 0a996f51-8f4d-4537-a941-aa692ff88bf8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:45.115400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-f7afbee3-3328-4dc2-850c-c3cca5767a40 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29a589c1141436ba4c052ceff48a99f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c66c53d7c443749ee12d9c6478a8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:45.124210 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-f7afbee3-3328-4dc2-850c-c3cca5767a40 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] 10.222.0.58 "GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8" status: 200 len: 1215 microversion: 2.1 time: 0.127973 May 12 11:45:45.124788 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 60/115] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:44 2022] GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8 => generated 1215 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:45.246523 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-1c91ec6c-7c80-4e64-bec7-3ddbee2e9041 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:45.255237 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-1c91ec6c-7c80-4e64-bec7-3ddbee2e9041 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.317701 May 12 11:45:45.262415 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 56/116] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:44 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:45:45.508377 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-adf03527-1176-4372-8c8c-2d382cba4d75 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:45.508918 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-adf03527-1176-4372-8c8c-2d382cba4d75 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:45.517272 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-adf03527-1176-4372-8c8c-2d382cba4d75 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:45.517674 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-adf03527-1176-4372-8c8c-2d382cba4d75 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:45.518548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-adf03527-1176-4372-8c8c-2d382cba4d75 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:45.518951 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-adf03527-1176-4372-8c8c-2d382cba4d75 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:45.905117 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-adf03527-1176-4372-8c8c-2d382cba4d75 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:45.917501 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-adf03527-1176-4372-8c8c-2d382cba4d75 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:45.920581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-adf03527-1176-4372-8c8c-2d382cba4d75 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:45.929668 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-adf03527-1176-4372-8c8c-2d382cba4d75 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1598 microversion: 2.20 time: 0.424903 May 12 11:45:45.930117 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 61/117] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:45:45 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1598 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:45:45.952308 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-4a35239a-91fc-4b9f-97ec-065f8b3ebfbf tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:45.952993 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-4a35239a-91fc-4b9f-97ec-065f8b3ebfbf tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:45.968339 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4a35239a-91fc-4b9f-97ec-065f8b3ebfbf tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:45.968747 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4a35239a-91fc-4b9f-97ec-065f8b3ebfbf tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:45.969548 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4a35239a-91fc-4b9f-97ec-065f8b3ebfbf tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:45.970024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4a35239a-91fc-4b9f-97ec-065f8b3ebfbf tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:46.140495 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-0326130e-6d83-469c-bd74-81ecab598a44 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:46.142244 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-0326130e-6d83-469c-bd74-81ecab598a44 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] [instance: 0a996f51-8f4d-4537-a941-aa692ff88bf8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:46.151328 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0326130e-6d83-469c-bd74-81ecab598a44 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:46.152900 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0326130e-6d83-469c-bd74-81ecab598a44 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:46.154600 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0326130e-6d83-469c-bd74-81ecab598a44 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:46.155284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0326130e-6d83-469c-bd74-81ecab598a44 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:46.234896 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-4a35239a-91fc-4b9f-97ec-065f8b3ebfbf tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.288939 May 12 11:45:46.235657 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 57/118] 10.222.0.58 () {60 vars in 1315 bytes} [Thu May 12 11:45:45 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916/os-interface => generated 284 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 11:45:46.269287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-0326130e-6d83-469c-bd74-81ecab598a44 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29a589c1141436ba4c052ceff48a99f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c66c53d7c443749ee12d9c6478a8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:46.280061 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ebef72e5-c1e5-4cc6-9c6a-b1c050370adf tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:46.280671 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-ebef72e5-c1e5-4cc6-9c6a-b1c050370adf tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:46.288233 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-0326130e-6d83-469c-bd74-81ecab598a44 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] 10.222.0.58 "GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8" status: 200 len: 1267 microversion: 2.1 time: 0.151441 May 12 11:45:46.298667 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 62/119] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:46 2022] GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:46.302773 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ebef72e5-c1e5-4cc6-9c6a-b1c050370adf tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:46.303587 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ebef72e5-c1e5-4cc6-9c6a-b1c050370adf tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:46.304744 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ebef72e5-c1e5-4cc6-9c6a-b1c050370adf tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:46.305193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ebef72e5-c1e5-4cc6-9c6a-b1c050370adf tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:46.850386 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-ebef72e5-c1e5-4cc6-9c6a-b1c050370adf tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:46.863973 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-ebef72e5-c1e5-4cc6-9c6a-b1c050370adf tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.588004 May 12 11:45:46.877147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 58/120] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:46 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:45:47.112409 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-9b110d97-2799-4c57-845c-dda83aadf074 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:47.113438 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-9b110d97-2799-4c57-845c-dda83aadf074 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:47.142762 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9b110d97-2799-4c57-845c-dda83aadf074 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:47.145508 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9b110d97-2799-4c57-845c-dda83aadf074 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:47.146586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9b110d97-2799-4c57-845c-dda83aadf074 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:47.150745 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9b110d97-2799-4c57-845c-dda83aadf074 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:47.183804 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-9b110d97-2799-4c57-845c-dda83aadf074 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Going to try to terminate instance {{(pid=123507) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 11:45:47.306787 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-149b0645-aa8c-426b-a2f3-109bbf1c55e6 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:47.308467 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-149b0645-aa8c-426b-a2f3-109bbf1c55e6 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] [instance: 0a996f51-8f4d-4537-a941-aa692ff88bf8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:47.316044 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-149b0645-aa8c-426b-a2f3-109bbf1c55e6 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:47.316684 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-149b0645-aa8c-426b-a2f3-109bbf1c55e6 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:47.319178 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-149b0645-aa8c-426b-a2f3-109bbf1c55e6 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:47.322386 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-149b0645-aa8c-426b-a2f3-109bbf1c55e6 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:47.390871 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-9b110d97-2799-4c57-845c-dda83aadf074 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 204 len: 0 microversion: 2.1 time: 0.281825 May 12 11:45:47.391739 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 63/121] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:45:47 2022] DELETE /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 11:45:47.400449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-d5aaca67-57a2-455e-b666-75fa4ecdeb40 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:47.401414 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d5aaca67-57a2-455e-b666-75fa4ecdeb40 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:47.409472 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d5aaca67-57a2-455e-b666-75fa4ecdeb40 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:47.409969 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d5aaca67-57a2-455e-b666-75fa4ecdeb40 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:47.415103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d5aaca67-57a2-455e-b666-75fa4ecdeb40 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:47.415793 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d5aaca67-57a2-455e-b666-75fa4ecdeb40 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:47.716735 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-d5aaca67-57a2-455e-b666-75fa4ecdeb40 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5418744ce43cf8074de1d2f0de6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52f1a625344430ba655dc6c40eebb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:47.724904 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-d5aaca67-57a2-455e-b666-75fa4ecdeb40 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 200 len: 1553 microversion: 2.1 time: 0.328473 May 12 11:45:47.725486 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 64/122] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:47 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 1553 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:47.774850 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-149b0645-aa8c-426b-a2f3-109bbf1c55e6 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29a589c1141436ba4c052ceff48a99f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c66c53d7c443749ee12d9c6478a8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:47.786203 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-149b0645-aa8c-426b-a2f3-109bbf1c55e6 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] 10.222.0.58 "GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8" status: 200 len: 1273 microversion: 2.1 time: 0.483304 May 12 11:45:47.788238 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 59/123] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:47 2022] GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8 => generated 1273 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:47.881911 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-f23243a3-b1e3-41f7-a982-3e7d48365962 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:47.882591 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-f23243a3-b1e3-41f7-a982-3e7d48365962 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:47.891279 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f23243a3-b1e3-41f7-a982-3e7d48365962 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:47.893842 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f23243a3-b1e3-41f7-a982-3e7d48365962 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:47.894677 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f23243a3-b1e3-41f7-a982-3e7d48365962 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:47.895119 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f23243a3-b1e3-41f7-a982-3e7d48365962 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:48.157044 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-f23243a3-b1e3-41f7-a982-3e7d48365962 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:48.178578 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-f23243a3-b1e3-41f7-a982-3e7d48365962 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.300963 May 12 11:45:48.180275 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 65/124] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:47 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:48.743365 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-2b95b618-59af-4282-b2df-37c5f9899b6c tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:48.744545 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-2b95b618-59af-4282-b2df-37c5f9899b6c tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:48.751007 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2b95b618-59af-4282-b2df-37c5f9899b6c tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:48.751858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2b95b618-59af-4282-b2df-37c5f9899b6c tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:48.765342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2b95b618-59af-4282-b2df-37c5f9899b6c tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:48.766949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2b95b618-59af-4282-b2df-37c5f9899b6c tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:48.805540 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-b17b1035-cfff-4a9a-a6fb-6564f2029105 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:48.806254 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-b17b1035-cfff-4a9a-a6fb-6564f2029105 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] [instance: 0a996f51-8f4d-4537-a941-aa692ff88bf8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:48.814545 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b17b1035-cfff-4a9a-a6fb-6564f2029105 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:48.815000 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b17b1035-cfff-4a9a-a6fb-6564f2029105 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:48.817833 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b17b1035-cfff-4a9a-a6fb-6564f2029105 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:48.818327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b17b1035-cfff-4a9a-a6fb-6564f2029105 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:49.107781 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-2b95b618-59af-4282-b2df-37c5f9899b6c tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5418744ce43cf8074de1d2f0de6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52f1a625344430ba655dc6c40eebb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:49.123014 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-2b95b618-59af-4282-b2df-37c5f9899b6c tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 200 len: 1553 microversion: 2.1 time: 0.384196 May 12 11:45:49.126131 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 60/125] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:48 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 1553 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:45:49.137039 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-7da013aa-c49b-4e95-a0eb-2a0029b48447 req-64fa6251-33d0-43c8-bd0e-2b8634542164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5cd2aad-2374-4ded-8b72-2e54fbbad916", "tag": "d3632d97-f0ea-41b4-9003-a50ffebf91df"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:45:49.160637 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-7da013aa-c49b-4e95-a0eb-2a0029b48447 req-64fa6251-33d0-43c8-bd0e-2b8634542164 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:49.161086 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-7da013aa-c49b-4e95-a0eb-2a0029b48447 req-64fa6251-33d0-43c8-bd0e-2b8634542164 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:49.182379 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-7da013aa-c49b-4e95-a0eb-2a0029b48447 req-64fa6251-33d0-43c8-bd0e-2b8634542164 service nova] Creating event network-changed:d3632d97-f0ea-41b4-9003-a50ffebf91df for instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 on hv-cinder-80473 May 12 11:45:49.197456 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-7da013aa-c49b-4e95-a0eb-2a0029b48447 req-64fa6251-33d0-43c8-bd0e-2b8634542164 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068251 May 12 11:45:49.198591 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 61/126] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:45:49.211072 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-4b620611-17df-42de-9392-daeb3125e7f4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:49.213733 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-4b620611-17df-42de-9392-daeb3125e7f4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:49.228547 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4b620611-17df-42de-9392-daeb3125e7f4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:49.229335 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4b620611-17df-42de-9392-daeb3125e7f4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:49.232070 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4b620611-17df-42de-9392-daeb3125e7f4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:49.233049 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4b620611-17df-42de-9392-daeb3125e7f4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:49.367311 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b17b1035-cfff-4a9a-a6fb-6564f2029105 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29a589c1141436ba4c052ceff48a99f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c66c53d7c443749ee12d9c6478a8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:49.377569 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-b17b1035-cfff-4a9a-a6fb-6564f2029105 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] 10.222.0.58 "GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8" status: 200 len: 1315 microversion: 2.1 time: 0.576234 May 12 11:45:49.386874 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 66/127] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:48 2022] GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8 => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:49.774916 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-4b620611-17df-42de-9392-daeb3125e7f4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:49.786171 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-4b620611-17df-42de-9392-daeb3125e7f4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.583516 May 12 11:45:49.786171 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 62/128] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:49 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:50.143698 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-bf100cda-35e5-4911-8bd7-2f3d1aa64f7d tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:50.144893 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-bf100cda-35e5-4911-8bd7-2f3d1aa64f7d tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:50.168185 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bf100cda-35e5-4911-8bd7-2f3d1aa64f7d tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:50.170913 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bf100cda-35e5-4911-8bd7-2f3d1aa64f7d tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:50.172888 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bf100cda-35e5-4911-8bd7-2f3d1aa64f7d tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:50.174678 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bf100cda-35e5-4911-8bd7-2f3d1aa64f7d tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:50.395189 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-119f617f-4b76-48b0-b7e8-d37a8bd4667b tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:50.395808 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-119f617f-4b76-48b0-b7e8-d37a8bd4667b tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] [instance: 0a996f51-8f4d-4537-a941-aa692ff88bf8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:50.417191 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-119f617f-4b76-48b0-b7e8-d37a8bd4667b tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:50.418056 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-119f617f-4b76-48b0-b7e8-d37a8bd4667b tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:50.419029 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-119f617f-4b76-48b0-b7e8-d37a8bd4667b tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:50.420321 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-119f617f-4b76-48b0-b7e8-d37a8bd4667b tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:50.679558 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-119f617f-4b76-48b0-b7e8-d37a8bd4667b tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29a589c1141436ba4c052ceff48a99f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c66c53d7c443749ee12d9c6478a8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:50.693639 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-119f617f-4b76-48b0-b7e8-d37a8bd4667b tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] 10.222.0.58 "GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8" status: 200 len: 1315 microversion: 2.1 time: 0.302992 May 12 11:45:50.695486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 63/129] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:50 2022] GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:50.715441 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-bf100cda-35e5-4911-8bd7-2f3d1aa64f7d tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5418744ce43cf8074de1d2f0de6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52f1a625344430ba655dc6c40eebb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:50.726275 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-bf100cda-35e5-4911-8bd7-2f3d1aa64f7d tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 200 len: 1553 microversion: 2.1 time: 0.587681 May 12 11:45:50.727867 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 67/130] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:50 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 1553 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:50.806912 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-d5310419-98a7-492c-8252-6beb654120e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:50.808294 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d5310419-98a7-492c-8252-6beb654120e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:50.819827 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d5310419-98a7-492c-8252-6beb654120e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:50.820977 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d5310419-98a7-492c-8252-6beb654120e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:50.829065 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d5310419-98a7-492c-8252-6beb654120e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:50.831351 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d5310419-98a7-492c-8252-6beb654120e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:50.970665 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-ce1b7439-32c1-407e-a36e-1389f2f05777 req-4f7fad09-c148-4872-bf4d-75b3eb5642c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ed37963-294c-49b1-a66f-03e5cf54ec97", "name": "network-vif-deleted", "tag": "7c309744-6140-4aca-b512-8fb1c111f618"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:45:50.985271 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-ce1b7439-32c1-407e-a36e-1389f2f05777 req-4f7fad09-c148-4872-bf4d-75b3eb5642c9 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:50.985733 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-ce1b7439-32c1-407e-a36e-1389f2f05777 req-4f7fad09-c148-4872-bf4d-75b3eb5642c9 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:51.024430 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-ce1b7439-32c1-407e-a36e-1389f2f05777 req-4f7fad09-c148-4872-bf4d-75b3eb5642c9 service nova] Creating event network-vif-deleted:7c309744-6140-4aca-b512-8fb1c111f618 for instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 on hv-cinder-80473 May 12 11:45:51.051836 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-ce1b7439-32c1-407e-a36e-1389f2f05777 req-4f7fad09-c148-4872-bf4d-75b3eb5642c9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081033 May 12 11:45:51.052541 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 68/131] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:45:51.202369 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-d5310419-98a7-492c-8252-6beb654120e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:51.213171 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-d5310419-98a7-492c-8252-6beb654120e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.413698 May 12 11:45:51.223947 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 64/132] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:50 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:51.715635 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-50fb62eb-3430-47ba-8abd-828f961d9b9e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:51.716434 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-50fb62eb-3430-47ba-8abd-828f961d9b9e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] [instance: 0a996f51-8f4d-4537-a941-aa692ff88bf8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:51.729965 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-50fb62eb-3430-47ba-8abd-828f961d9b9e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:51.738022 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-50fb62eb-3430-47ba-8abd-828f961d9b9e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:51.739992 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-50fb62eb-3430-47ba-8abd-828f961d9b9e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:51.740769 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-50fb62eb-3430-47ba-8abd-828f961d9b9e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:51.744142 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-1c8d0b71-1ba8-4f96-ac76-e928fc59ed28 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:51.744760 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-1c8d0b71-1ba8-4f96-ac76-e928fc59ed28 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:51.757988 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1c8d0b71-1ba8-4f96-ac76-e928fc59ed28 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:51.758607 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1c8d0b71-1ba8-4f96-ac76-e928fc59ed28 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:51.759411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1c8d0b71-1ba8-4f96-ac76-e928fc59ed28 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:51.760027 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1c8d0b71-1ba8-4f96-ac76-e928fc59ed28 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:51.819275 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1c8d0b71-1ba8-4f96-ac76-e928fc59ed28 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:51.820544 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1c8d0b71-1ba8-4f96-ac76-e928fc59ed28 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:51.821180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.objects.instance [None req-1c8d0b71-1ba8-4f96-ac76-e928fc59ed28 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lazy-loading 'fault' on Instance uuid 2ed37963-294c-49b1-a66f-03e5cf54ec97 {{(pid=123508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:45:51.882773 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-1c8d0b71-1ba8-4f96-ac76-e928fc59ed28 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fc5418744ce43cf8074de1d2f0de6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b52f1a625344430ba655dc6c40eebb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:51.894993 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-1c8d0b71-1ba8-4f96-ac76-e928fc59ed28 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 200 len: 1350 microversion: 2.1 time: 0.154472 May 12 11:45:51.896580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 65/133] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:51 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 1350 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:52.022529 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-50fb62eb-3430-47ba-8abd-828f961d9b9e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29a589c1141436ba4c052ceff48a99f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c66c53d7c443749ee12d9c6478a8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:52.046521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-50fb62eb-3430-47ba-8abd-828f961d9b9e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] 10.222.0.58 "GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8" status: 200 len: 1315 microversion: 2.1 time: 0.337539 May 12 11:45:52.047812 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 69/134] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:51 2022] GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8 => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:45:52.230501 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-bdb81183-d5d5-467f-9fd3-df6b2f6ac501 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:52.231376 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-bdb81183-d5d5-467f-9fd3-df6b2f6ac501 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:52.257222 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bdb81183-d5d5-467f-9fd3-df6b2f6ac501 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:52.259097 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bdb81183-d5d5-467f-9fd3-df6b2f6ac501 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:52.260595 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bdb81183-d5d5-467f-9fd3-df6b2f6ac501 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:52.267072 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bdb81183-d5d5-467f-9fd3-df6b2f6ac501 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:52.521284 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-bdb81183-d5d5-467f-9fd3-df6b2f6ac501 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:52.529010 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-bdb81183-d5d5-467f-9fd3-df6b2f6ac501 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.302374 May 12 11:45:52.530346 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 66/135] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:52 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:52.923205 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-ce2addbf-795f-41ad-b55a-b6b089476095 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:52.924537 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-ce2addbf-795f-41ad-b55a-b6b089476095 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:52.932165 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ce2addbf-795f-41ad-b55a-b6b089476095 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:52.932840 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ce2addbf-795f-41ad-b55a-b6b089476095 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:52.933895 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ce2addbf-795f-41ad-b55a-b6b089476095 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:52.935916 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ce2addbf-795f-41ad-b55a-b6b089476095 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:52.980223 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-ce2addbf-795f-41ad-b55a-b6b089476095 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] HTTP exception thrown: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. May 12 11:45:52.989586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-ce2addbf-795f-41ad-b55a-b6b089476095 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Request method failure captured: May 12 11:45:52.989586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 HTTP/1.1 May 12 11:45:52.989586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:45:52.989586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:45:52.989586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:45:52.989586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 0 May 12 11:45:52.989586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:45:52.989586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:45:52.989586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:45:52.989586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:45:52.989586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPM4yu67r1fQxOKosl_aXj2rlnIaR7J-DKay8R5-O5tX4QFizV7Z6zVPk-xCdqzKqRM3onGD-LpbuljlrDV5zek0flXeoczrZEzoMz4_oqXIPtESdcS2orbZ_H3r1Y8r3dToWlWEZGWZhHCMqowfQK8dRv_DHfDOH_zGmJCh9DIv2Pw May 12 11:45:52.989586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:45:52.989586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:45:52.989586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:45:52.989586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:45:52.989586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:45:52.989586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:45:52.989586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: 4b52f1a625344430ba655dc6c40eebb3 May 12 11:45:52.989586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-DeleteServersTestJSON-358187463 May 12 11:45:52.989586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:45:52.989586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:45:52.991185 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4b52f1a625344430ba655dc6c40eebb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4b52f1a625344430ba655dc6c40eebb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4b52f1a625344430ba655dc6c40eebb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4b52f1a625344430ba655dc6c40eebb3", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:45:52.991185 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-DeleteServersTestJSON-358187463 May 12 11:45:52.991185 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: 4b52f1a625344430ba655dc6c40eebb3 May 12 11:45:52.991185 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-DeleteServersTestJSON-358187463 May 12 11:45:52.991185 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-DeleteServersTestJSON-358187463-project May 12 11:45:52.991185 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:45:52.991185 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:45:52.991185 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: 3fc5418744ce43cf8074de1d2f0de6cf May 12 11:45:52.991185 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-DeleteServersTestJSON-358187463-project May 12 11:45:52.991185 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: > May 12 11:45:52.991185 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. May 12 11:45:52.991185 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'id': '2ed37963-294c-49b1-a66f-03e5cf54ec97'} May 12 11:45:52.992306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:45:52.992306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:52.992306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:45:52.992306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:45:52.992306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:45:52.992306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:45:52.992306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:45:52.992306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:45:52.992306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:45:52.992306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:45:52.992306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. May 12 11:45:52.992306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:45:52.992306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:45:52.992306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:45:52.992306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:52.992306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:45:52.992306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:45:52.992306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:45:52.992306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:45:52.992306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:45:52.994181 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:45:52.994181 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:45:52.994181 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:45:52.994181 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:45:52.994181 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:45:52.994181 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:45:52.994181 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:45:52.994181 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. May 12 11:45:52.994181 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:45:52.994181 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:45:52.994181 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:45:52.994181 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:52.994181 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:45:52.994181 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:45:52.994181 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:45:52.994181 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:45:52.994181 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. May 12 11:45:52.994181 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:45:52.995907 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-ce2addbf-795f-41ad-b55a-b6b089476095 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Returning 404 to user: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:45:52.995907 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-ce2addbf-795f-41ad-b55a-b6b089476095 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 404 len: 111 microversion: 2.1 time: 0.077228 May 12 11:45:52.995907 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 70/136] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:52 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:45:53.066565 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-065b5922-ef85-4005-af45-3b7718f89d50 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:53.067293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-065b5922-ef85-4005-af45-3b7718f89d50 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] [instance: 0a996f51-8f4d-4537-a941-aa692ff88bf8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:53.075835 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-065b5922-ef85-4005-af45-3b7718f89d50 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:53.078212 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-065b5922-ef85-4005-af45-3b7718f89d50 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:53.079838 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-065b5922-ef85-4005-af45-3b7718f89d50 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:53.081140 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-065b5922-ef85-4005-af45-3b7718f89d50 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:53.126098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-5a93fc0f-022c-482a-af8b-f94f4836ab2d req-1ff8cf7f-b1dc-4fb7-aed1-a1521df40bea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a996f51-8f4d-4537-a941-aa692ff88bf8", "tag": "87ba847e-ae2b-4b3f-9599-8f68310d239a"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:45:53.159657 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-5a93fc0f-022c-482a-af8b-f94f4836ab2d req-1ff8cf7f-b1dc-4fb7-aed1-a1521df40bea service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:53.163835 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-5a93fc0f-022c-482a-af8b-f94f4836ab2d req-1ff8cf7f-b1dc-4fb7-aed1-a1521df40bea service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:53.183074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-5a93fc0f-022c-482a-af8b-f94f4836ab2d req-1ff8cf7f-b1dc-4fb7-aed1-a1521df40bea service nova] Creating event network-changed:87ba847e-ae2b-4b3f-9599-8f68310d239a for instance 0a996f51-8f4d-4537-a941-aa692ff88bf8 on hv-cinder-80473 May 12 11:45:53.188040 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-5a93fc0f-022c-482a-af8b-f94f4836ab2d req-1ff8cf7f-b1dc-4fb7-aed1-a1521df40bea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066420 May 12 11:45:53.188987 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 71/137] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:45:53.195748 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-bf4d4e5b-2edd-4e98-8f13-4b901438e59c tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:53.196941 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-bf4d4e5b-2edd-4e98-8f13-4b901438e59c tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:53.204474 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bf4d4e5b-2edd-4e98-8f13-4b901438e59c tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:53.205350 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bf4d4e5b-2edd-4e98-8f13-4b901438e59c tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:53.207015 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bf4d4e5b-2edd-4e98-8f13-4b901438e59c tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:53.207618 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bf4d4e5b-2edd-4e98-8f13-4b901438e59c tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:53.222619 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-bf4d4e5b-2edd-4e98-8f13-4b901438e59c tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] HTTP exception thrown: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. May 12 11:45:53.224824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-bf4d4e5b-2edd-4e98-8f13-4b901438e59c tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Request method failure captured: May 12 11:45:53.224824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97/os-volume_attachments HTTP/1.1 May 12 11:45:53.224824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:45:53.224824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:45:53.224824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:45:53.224824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 0 May 12 11:45:53.224824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:45:53.224824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:45:53.224824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:45:53.224824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:45:53.224824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPM4yu67r1fQxOKosl_aXj2rlnIaR7J-DKay8R5-O5tX4QFizV7Z6zVPk-xCdqzKqRM3onGD-LpbuljlrDV5zek0flXeoczrZEzoMz4_oqXIPtESdcS2orbZ_H3r1Y8r3dToWlWEZGWZhHCMqowfQK8dRv_DHfDOH_zGmJCh9DIv2Pw May 12 11:45:53.224824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:45:53.224824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:45:53.224824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:45:53.224824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:45:53.224824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:45:53.224824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:45:53.224824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: 4b52f1a625344430ba655dc6c40eebb3 May 12 11:45:53.224824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-DeleteServersTestJSON-358187463 May 12 11:45:53.224824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:45:53.224824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:45:53.226288 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4b52f1a625344430ba655dc6c40eebb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4b52f1a625344430ba655dc6c40eebb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4b52f1a625344430ba655dc6c40eebb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4b52f1a625344430ba655dc6c40eebb3", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:45:53.226288 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-DeleteServersTestJSON-358187463 May 12 11:45:53.226288 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: 4b52f1a625344430ba655dc6c40eebb3 May 12 11:45:53.226288 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-DeleteServersTestJSON-358187463 May 12 11:45:53.226288 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-DeleteServersTestJSON-358187463-project May 12 11:45:53.226288 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:45:53.226288 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:45:53.226288 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: 3fc5418744ce43cf8074de1d2f0de6cf May 12 11:45:53.226288 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-DeleteServersTestJSON-358187463-project May 12 11:45:53.226288 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: > May 12 11:45:53.226288 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. May 12 11:45:53.226288 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'server_id': '2ed37963-294c-49b1-a66f-03e5cf54ec97'} May 12 11:45:53.227095 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:45:53.227095 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:53.227095 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:45:53.227095 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:45:53.227095 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:45:53.227095 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:45:53.227095 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:45:53.227095 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:45:53.227095 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:45:53.227095 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:45:53.227095 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. May 12 11:45:53.227095 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:45:53.227095 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:45:53.227095 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:45:53.227095 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:53.227095 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:45:53.227095 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:45:53.227095 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:45:53.227095 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:45:53.227095 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:45:53.228458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:45:53.228458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 12 11:45:53.228458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 11:45:53.228458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 12 11:45:53.228458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 11:45:53.228458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 12 11:45:53.228458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 12 11:45:53.228458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:45:53.228458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:45:53.228458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. May 12 11:45:53.228458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:45:53.228458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:45:53.228458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:45:53.228458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:53.228458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:45:53.228458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:45:53.228458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:45:53.228458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:45:53.228458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. May 12 11:45:53.228458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:45:53.230485 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-bf4d4e5b-2edd-4e98-8f13-4b901438e59c tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Returning 404 to user: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:45:53.232075 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-bf4d4e5b-2edd-4e98-8f13-4b901438e59c tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041085 May 12 11:45:53.233759 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 72/138] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 12 11:45:53 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:45:53.271591 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-065b5922-ef85-4005-af45-3b7718f89d50 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29a589c1141436ba4c052ceff48a99f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c66c53d7c443749ee12d9c6478a8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:53.281937 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-065b5922-ef85-4005-af45-3b7718f89d50 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] 10.222.0.58 "GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8" status: 200 len: 1315 microversion: 2.1 time: 0.220719 May 12 11:45:53.290701 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 67/139] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:53 2022] GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:53.547364 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-ef775885-d392-4b68-a3d2-c78c87bd2861 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:53.548271 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-ef775885-d392-4b68-a3d2-c78c87bd2861 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:53.558017 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ef775885-d392-4b68-a3d2-c78c87bd2861 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:53.558461 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ef775885-d392-4b68-a3d2-c78c87bd2861 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:53.559399 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ef775885-d392-4b68-a3d2-c78c87bd2861 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:53.560048 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ef775885-d392-4b68-a3d2-c78c87bd2861 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:53.772796 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-ef775885-d392-4b68-a3d2-c78c87bd2861 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:53.784064 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-ef775885-d392-4b68-a3d2-c78c87bd2861 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.240095 May 12 11:45:53.785493 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 73/140] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:53 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:54.302449 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b53e4595-7096-4eb3-a489-d76a91c6cf0e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:54.304251 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-b53e4595-7096-4eb3-a489-d76a91c6cf0e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] [instance: 0a996f51-8f4d-4537-a941-aa692ff88bf8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:54.311181 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b53e4595-7096-4eb3-a489-d76a91c6cf0e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:54.311633 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b53e4595-7096-4eb3-a489-d76a91c6cf0e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:54.312414 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b53e4595-7096-4eb3-a489-d76a91c6cf0e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:54.312856 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b53e4595-7096-4eb3-a489-d76a91c6cf0e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:54.468210 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b53e4595-7096-4eb3-a489-d76a91c6cf0e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29a589c1141436ba4c052ceff48a99f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c66c53d7c443749ee12d9c6478a8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:54.476184 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-b53e4595-7096-4eb3-a489-d76a91c6cf0e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] 10.222.0.58 "GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8" status: 200 len: 1315 microversion: 2.1 time: 0.178111 May 12 11:45:54.476766 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 68/141] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:54 2022] GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:54.520863 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-89274c93-bc62-4925-866c-6eee524223f7 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:54.521338 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-89274c93-bc62-4925-866c-6eee524223f7 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:54.528886 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-89274c93-bc62-4925-866c-6eee524223f7 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:54.529432 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-89274c93-bc62-4925-866c-6eee524223f7 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:54.530472 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-89274c93-bc62-4925-866c-6eee524223f7 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:54.530919 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-89274c93-bc62-4925-866c-6eee524223f7 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:54.549844 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-89274c93-bc62-4925-866c-6eee524223f7 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] HTTP exception thrown: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. May 12 11:45:54.551395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-89274c93-bc62-4925-866c-6eee524223f7 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Request method failure captured: May 12 11:45:54.551395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: DELETE /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 HTTP/1.1 May 12 11:45:54.551395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:45:54.551395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:45:54.551395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:45:54.551395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 0 May 12 11:45:54.551395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:45:54.551395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:45:54.551395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:45:54.551395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:45:54.551395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPM4yu67r1fQxOKosl_aXj2rlnIaR7J-DKay8R5-O5tX4QFizV7Z6zVPk-xCdqzKqRM3onGD-LpbuljlrDV5zek0flXeoczrZEzoMz4_oqXIPtESdcS2orbZ_H3r1Y8r3dToWlWEZGWZhHCMqowfQK8dRv_DHfDOH_zGmJCh9DIv2Pw May 12 11:45:54.551395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:45:54.551395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:45:54.551395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:45:54.551395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:45:54.551395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:45:54.551395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:45:54.551395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: 4b52f1a625344430ba655dc6c40eebb3 May 12 11:45:54.551395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-DeleteServersTestJSON-358187463 May 12 11:45:54.551395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:45:54.551395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:45:54.552812 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4b52f1a625344430ba655dc6c40eebb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4b52f1a625344430ba655dc6c40eebb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4b52f1a625344430ba655dc6c40eebb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4b52f1a625344430ba655dc6c40eebb3", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:45:54.552812 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-DeleteServersTestJSON-358187463 May 12 11:45:54.552812 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: 4b52f1a625344430ba655dc6c40eebb3 May 12 11:45:54.552812 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-DeleteServersTestJSON-358187463 May 12 11:45:54.552812 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-DeleteServersTestJSON-358187463-project May 12 11:45:54.552812 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:45:54.552812 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:45:54.552812 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: 3fc5418744ce43cf8074de1d2f0de6cf May 12 11:45:54.552812 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-DeleteServersTestJSON-358187463-project May 12 11:45:54.552812 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: > May 12 11:45:54.552812 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. May 12 11:45:54.552812 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'id': '2ed37963-294c-49b1-a66f-03e5cf54ec97'} May 12 11:45:54.553596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:45:54.553596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:54.553596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:45:54.553596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:45:54.553596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:45:54.553596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:45:54.553596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:45:54.553596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:45:54.553596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:45:54.553596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:45:54.553596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. May 12 11:45:54.553596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:45:54.553596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:45:54.553596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:45:54.553596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:54.553596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:45:54.553596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:45:54.553596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:45:54.553596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:45:54.553596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:45:54.554993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:45:54.554993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 11:45:54.554993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 11:45:54.554993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 11:45:54.554993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 11:45:54.554993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:45:54.554993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:45:54.554993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:45:54.554993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:45:54.554993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. May 12 11:45:54.554993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:45:54.554993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:45:54.554993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:45:54.554993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:54.554993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:45:54.554993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:45:54.554993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:45:54.554993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:45:54.554993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. May 12 11:45:54.554993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:45:54.560046 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-89274c93-bc62-4925-866c-6eee524223f7 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Returning 404 to user: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:45:54.560046 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-89274c93-bc62-4925-866c-6eee524223f7 tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 404 len: 111 microversion: 2.1 time: 0.035761 May 12 11:45:54.560046 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 74/142] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:45:54 2022] DELETE /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:45:54.563996 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-28288266-23b9-4eae-af4a-f8db0dbc545f tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:54.564835 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-28288266-23b9-4eae-af4a-f8db0dbc545f tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] [instance: 2ed37963-294c-49b1-a66f-03e5cf54ec97] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:54.571612 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-28288266-23b9-4eae-af4a-f8db0dbc545f tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:54.572158 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-28288266-23b9-4eae-af4a-f8db0dbc545f tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:54.573119 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-28288266-23b9-4eae-af4a-f8db0dbc545f tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:54.574068 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-28288266-23b9-4eae-af4a-f8db0dbc545f tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:54.593931 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-28288266-23b9-4eae-af4a-f8db0dbc545f tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] HTTP exception thrown: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. May 12 11:45:54.598758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-28288266-23b9-4eae-af4a-f8db0dbc545f tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Request method failure captured: May 12 11:45:54.598758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 HTTP/1.1 May 12 11:45:54.598758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:45:54.598758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:45:54.598758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:45:54.598758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:45:54.598758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:45:54.598758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:45:54.598758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:45:54.598758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:45:54.598758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPM4yu67r1fQxOKosl_aXj2rlnIaR7J-DKay8R5-O5tX4QFizV7Z6zVPk-xCdqzKqRM3onGD-LpbuljlrDV5zek0flXeoczrZEzoMz4_oqXIPtESdcS2orbZ_H3r1Y8r3dToWlWEZGWZhHCMqowfQK8dRv_DHfDOH_zGmJCh9DIv2Pw May 12 11:45:54.598758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:45:54.598758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:45:54.598758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:45:54.598758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:45:54.598758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:45:54.598758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:45:54.598758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: 4b52f1a625344430ba655dc6c40eebb3 May 12 11:45:54.598758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-DeleteServersTestJSON-358187463 May 12 11:45:54.598758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:45:54.598758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:45:54.600295 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4b52f1a625344430ba655dc6c40eebb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4b52f1a625344430ba655dc6c40eebb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4b52f1a625344430ba655dc6c40eebb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4b52f1a625344430ba655dc6c40eebb3", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:45:54.600295 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-DeleteServersTestJSON-358187463 May 12 11:45:54.600295 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: 4b52f1a625344430ba655dc6c40eebb3 May 12 11:45:54.600295 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-DeleteServersTestJSON-358187463 May 12 11:45:54.600295 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-DeleteServersTestJSON-358187463-project May 12 11:45:54.600295 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:45:54.600295 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:45:54.600295 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 3fc5418744ce43cf8074de1d2f0de6cf May 12 11:45:54.600295 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-DeleteServersTestJSON-358187463-project May 12 11:45:54.600295 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:45:54.600295 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. May 12 11:45:54.600295 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': '2ed37963-294c-49b1-a66f-03e5cf54ec97'} May 12 11:45:54.601217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:45:54.601217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:54.601217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:45:54.601217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:45:54.601217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:45:54.601217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:45:54.601217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:45:54.601217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:45:54.601217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:45:54.601217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:45:54.601217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. May 12 11:45:54.601217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:54.601217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:45:54.601217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:54.601217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:54.601217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:45:54.601217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:45:54.601217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:45:54.601217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:45:54.601217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:45:54.602622 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:45:54.602622 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:45:54.602622 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:45:54.602622 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:45:54.602622 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:45:54.602622 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:45:54.602622 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:45:54.602622 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. May 12 11:45:54.602622 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:54.602622 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:45:54.602622 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:54.602622 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:45:54.602622 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:45:54.602622 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:45:54.602622 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:45:54.602622 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:45:54.602622 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. May 12 11:45:54.602622 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:45:54.603813 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-28288266-23b9-4eae-af4a-f8db0dbc545f tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] Returning 404 to user: Instance 2ed37963-294c-49b1-a66f-03e5cf54ec97 could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:45:54.603813 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-28288266-23b9-4eae-af4a-f8db0dbc545f tempest-DeleteServersTestJSON-358187463 tempest-DeleteServersTestJSON-358187463-project] 10.222.0.58 "GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97" status: 404 len: 111 microversion: 2.1 time: 0.043088 May 12 11:45:54.603813 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 69/143] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:54 2022] GET /compute/v2.1/servers/2ed37963-294c-49b1-a66f-03e5cf54ec97 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:45:54.803080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-49af5b5b-54d8-4ebb-a920-5314bf928ed1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:54.804087 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-49af5b5b-54d8-4ebb-a920-5314bf928ed1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:54.819526 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-49af5b5b-54d8-4ebb-a920-5314bf928ed1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:54.821695 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-49af5b5b-54d8-4ebb-a920-5314bf928ed1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:54.823898 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-49af5b5b-54d8-4ebb-a920-5314bf928ed1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:54.824664 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-49af5b5b-54d8-4ebb-a920-5314bf928ed1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:55.112224 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-49af5b5b-54d8-4ebb-a920-5314bf928ed1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:55.125219 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-49af5b5b-54d8-4ebb-a920-5314bf928ed1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.327253 May 12 11:45:55.126606 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 75/144] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:54 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:55.492500 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-49df956d-641e-410a-8b2b-48ad4f3183de tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:55.493403 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-49df956d-641e-410a-8b2b-48ad4f3183de tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] [instance: 0a996f51-8f4d-4537-a941-aa692ff88bf8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:55.506857 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-49df956d-641e-410a-8b2b-48ad4f3183de tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:55.507507 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-49df956d-641e-410a-8b2b-48ad4f3183de tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:55.508449 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-49df956d-641e-410a-8b2b-48ad4f3183de tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:55.508995 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-49df956d-641e-410a-8b2b-48ad4f3183de tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:55.764654 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-49df956d-641e-410a-8b2b-48ad4f3183de tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29a589c1141436ba4c052ceff48a99f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c66c53d7c443749ee12d9c6478a8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:55.773823 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-49df956d-641e-410a-8b2b-48ad4f3183de tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] 10.222.0.58 "GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8" status: 200 len: 1315 microversion: 2.1 time: 0.285158 May 12 11:45:55.774631 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 70/145] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:55 2022] GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:56.144890 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-7d9e6110-031a-46a7-ace9-f39a8567b218 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:56.145498 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-7d9e6110-031a-46a7-ace9-f39a8567b218 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:56.154365 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7d9e6110-031a-46a7-ace9-f39a8567b218 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:56.155244 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7d9e6110-031a-46a7-ace9-f39a8567b218 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:56.156271 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7d9e6110-031a-46a7-ace9-f39a8567b218 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:56.157399 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7d9e6110-031a-46a7-ace9-f39a8567b218 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:56.379262 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-7d9e6110-031a-46a7-ace9-f39a8567b218 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:56.391842 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-7d9e6110-031a-46a7-ace9-f39a8567b218 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.252318 May 12 11:45:56.392998 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 76/146] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:56 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:56.792451 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-1295f847-068d-4beb-a55a-4ade8452cfd8 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:56.793133 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-1295f847-068d-4beb-a55a-4ade8452cfd8 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] [instance: 0a996f51-8f4d-4537-a941-aa692ff88bf8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:56.805624 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1295f847-068d-4beb-a55a-4ade8452cfd8 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:56.806145 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1295f847-068d-4beb-a55a-4ade8452cfd8 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:56.806927 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1295f847-068d-4beb-a55a-4ade8452cfd8 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:56.807360 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1295f847-068d-4beb-a55a-4ade8452cfd8 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:56.966285 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-1295f847-068d-4beb-a55a-4ade8452cfd8 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29a589c1141436ba4c052ceff48a99f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c66c53d7c443749ee12d9c6478a8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:56.976874 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-1295f847-068d-4beb-a55a-4ade8452cfd8 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] 10.222.0.58 "GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8" status: 200 len: 1315 microversion: 2.1 time: 0.188672 May 12 11:45:56.979451 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 71/147] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:56 2022] GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:57.013812 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-806abb60-43a3-4a89-9f0f-9fc732a12117 req-9268df68-f8fa-4deb-adad-30d64e756f63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a996f51-8f4d-4537-a941-aa692ff88bf8", "name": "network-vif-plugged", "status": "completed", "tag": "87ba847e-ae2b-4b3f-9599-8f68310d239a"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:45:57.030655 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-806abb60-43a3-4a89-9f0f-9fc732a12117 req-9268df68-f8fa-4deb-adad-30d64e756f63 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:57.032325 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-806abb60-43a3-4a89-9f0f-9fc732a12117 req-9268df68-f8fa-4deb-adad-30d64e756f63 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:57.063342 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-806abb60-43a3-4a89-9f0f-9fc732a12117 req-9268df68-f8fa-4deb-adad-30d64e756f63 service nova] Creating event network-vif-plugged:87ba847e-ae2b-4b3f-9599-8f68310d239a for instance 0a996f51-8f4d-4537-a941-aa692ff88bf8 on hv-cinder-80473 May 12 11:45:57.079983 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-806abb60-43a3-4a89-9f0f-9fc732a12117 req-9268df68-f8fa-4deb-adad-30d64e756f63 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070493 May 12 11:45:57.081689 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 77/148] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:45:57.409063 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ce735b82-9a11-4a9c-b688-212418c00938 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:57.409667 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-ce735b82-9a11-4a9c-b688-212418c00938 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:57.420912 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ce735b82-9a11-4a9c-b688-212418c00938 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:57.421357 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ce735b82-9a11-4a9c-b688-212418c00938 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:57.422149 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ce735b82-9a11-4a9c-b688-212418c00938 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:57.426788 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ce735b82-9a11-4a9c-b688-212418c00938 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:57.646411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-ce735b82-9a11-4a9c-b688-212418c00938 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:57.667629 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-ce735b82-9a11-4a9c-b688-212418c00938 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.262647 May 12 11:45:57.669999 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 72/149] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:57 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:57.995668 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-d042f259-fe37-48f7-91b2-54392b04d3da tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:57.997471 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d042f259-fe37-48f7-91b2-54392b04d3da tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] [instance: 0a996f51-8f4d-4537-a941-aa692ff88bf8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:58.004557 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d042f259-fe37-48f7-91b2-54392b04d3da tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:58.005306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d042f259-fe37-48f7-91b2-54392b04d3da tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:58.006430 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d042f259-fe37-48f7-91b2-54392b04d3da tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:58.006922 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d042f259-fe37-48f7-91b2-54392b04d3da tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:58.234191 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-d042f259-fe37-48f7-91b2-54392b04d3da tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29a589c1141436ba4c052ceff48a99f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c66c53d7c443749ee12d9c6478a8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:58.250340 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-d042f259-fe37-48f7-91b2-54392b04d3da tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] 10.222.0.58 "GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8" status: 200 len: 1315 microversion: 2.1 time: 0.258871 May 12 11:45:58.251533 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 78/150] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:57 2022] GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:58.684384 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-0e29d709-920b-4cb2-b95b-f7acb8da20f0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:58.685001 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-0e29d709-920b-4cb2-b95b-f7acb8da20f0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:58.705519 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0e29d709-920b-4cb2-b95b-f7acb8da20f0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:58.707085 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0e29d709-920b-4cb2-b95b-f7acb8da20f0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:58.707882 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0e29d709-920b-4cb2-b95b-f7acb8da20f0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:58.708323 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0e29d709-920b-4cb2-b95b-f7acb8da20f0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:58.970731 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-0e29d709-920b-4cb2-b95b-f7acb8da20f0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:58.990704 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-0e29d709-920b-4cb2-b95b-f7acb8da20f0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.309973 May 12 11:45:58.991294 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 73/151] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:58 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:45:59.268815 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-dfac4623-0d9a-4af3-a22e-c9ab09b33a1c tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:45:59.269574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-dfac4623-0d9a-4af3-a22e-c9ab09b33a1c tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] [instance: 0a996f51-8f4d-4537-a941-aa692ff88bf8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:45:59.285725 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-dfac4623-0d9a-4af3-a22e-c9ab09b33a1c tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:59.286329 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-dfac4623-0d9a-4af3-a22e-c9ab09b33a1c tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:59.287246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-dfac4623-0d9a-4af3-a22e-c9ab09b33a1c tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:45:59.287867 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-dfac4623-0d9a-4af3-a22e-c9ab09b33a1c tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:45:59.682967 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-dfac4623-0d9a-4af3-a22e-c9ab09b33a1c tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29a589c1141436ba4c052ceff48a99f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c66c53d7c443749ee12d9c6478a8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:45:59.691536 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-dfac4623-0d9a-4af3-a22e-c9ab09b33a1c tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] 10.222.0.58 "GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8" status: 200 len: 1315 microversion: 2.1 time: 0.426792 May 12 11:45:59.698244 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 79/152] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:45:59 2022] GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:00.009298 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-8aaeaec1-f40c-4c01-a471-ccfa3d0b27ec tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:00.009935 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-8aaeaec1-f40c-4c01-a471-ccfa3d0b27ec tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:00.016971 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8aaeaec1-f40c-4c01-a471-ccfa3d0b27ec tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:00.017428 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8aaeaec1-f40c-4c01-a471-ccfa3d0b27ec tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:00.018240 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8aaeaec1-f40c-4c01-a471-ccfa3d0b27ec tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:00.018813 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8aaeaec1-f40c-4c01-a471-ccfa3d0b27ec tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:00.254929 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8aaeaec1-f40c-4c01-a471-ccfa3d0b27ec tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:00.262171 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-8aaeaec1-f40c-4c01-a471-ccfa3d0b27ec tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.257129 May 12 11:46:00.263327 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 74/153] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:00 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:00.710174 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-b1841aec-1f7a-4dfa-993e-d323004316eb tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:00.711392 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-b1841aec-1f7a-4dfa-993e-d323004316eb tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] [instance: 0a996f51-8f4d-4537-a941-aa692ff88bf8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:00.719072 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b1841aec-1f7a-4dfa-993e-d323004316eb tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:00.719673 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b1841aec-1f7a-4dfa-993e-d323004316eb tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:00.720747 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b1841aec-1f7a-4dfa-993e-d323004316eb tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:00.721332 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b1841aec-1f7a-4dfa-993e-d323004316eb tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:01.153288 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b1841aec-1f7a-4dfa-993e-d323004316eb tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29a589c1141436ba4c052ceff48a99f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c66c53d7c443749ee12d9c6478a8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:01.161966 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-b1841aec-1f7a-4dfa-993e-d323004316eb tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] 10.222.0.58 "GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8" status: 200 len: 1464 microversion: 2.1 time: 0.455251 May 12 11:46:01.162635 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 80/154] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:00 2022] GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8 => generated 1464 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:01.208579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-f5627950-d95d-4a6b-9e6d-a0807980c70c tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:01.209832 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-f5627950-d95d-4a6b-9e6d-a0807980c70c tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] [instance: 0a996f51-8f4d-4537-a941-aa692ff88bf8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:01.216452 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f5627950-d95d-4a6b-9e6d-a0807980c70c tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:01.217087 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f5627950-d95d-4a6b-9e6d-a0807980c70c tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:01.219477 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f5627950-d95d-4a6b-9e6d-a0807980c70c tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:01.220271 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f5627950-d95d-4a6b-9e6d-a0807980c70c tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:01.250262 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-f5627950-d95d-4a6b-9e6d-a0807980c70c tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] [instance: 0a996f51-8f4d-4537-a941-aa692ff88bf8] Going to try to terminate instance {{(pid=123508) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 11:46:01.279441 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-8cbd33cf-495d-4cb1-9b77-19810198f335 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:01.280514 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-8cbd33cf-495d-4cb1-9b77-19810198f335 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:01.287353 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8cbd33cf-495d-4cb1-9b77-19810198f335 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:01.287810 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8cbd33cf-495d-4cb1-9b77-19810198f335 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:01.288596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8cbd33cf-495d-4cb1-9b77-19810198f335 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:01.289032 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8cbd33cf-495d-4cb1-9b77-19810198f335 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:01.383698 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-f5627950-d95d-4a6b-9e6d-a0807980c70c tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8" status: 204 len: 0 microversion: 2.1 time: 0.178672 May 12 11:46:01.384717 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 75/155] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:46:01 2022] DELETE /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 11:46:01.394714 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-36206592-99ca-4120-9f33-2d636d8018f0 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:01.395416 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-36206592-99ca-4120-9f33-2d636d8018f0 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] [instance: 0a996f51-8f4d-4537-a941-aa692ff88bf8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:01.402090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-36206592-99ca-4120-9f33-2d636d8018f0 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:01.402546 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-36206592-99ca-4120-9f33-2d636d8018f0 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:01.403856 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-36206592-99ca-4120-9f33-2d636d8018f0 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:01.404289 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-36206592-99ca-4120-9f33-2d636d8018f0 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:01.473212 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-8cbd33cf-495d-4cb1-9b77-19810198f335 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:01.482413 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-8cbd33cf-495d-4cb1-9b77-19810198f335 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.207298 May 12 11:46:01.484907 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 81/156] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:01 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:01.684324 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-36206592-99ca-4120-9f33-2d636d8018f0 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29a589c1141436ba4c052ceff48a99f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c66c53d7c443749ee12d9c6478a8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:01.695639 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-36206592-99ca-4120-9f33-2d636d8018f0 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] 10.222.0.58 "GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8" status: 200 len: 1470 microversion: 2.1 time: 0.305764 May 12 11:46:01.696459 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 76/157] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:01 2022] GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8 => generated 1470 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:02.513983 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-68b6730e-2607-4fa8-a243-eec0a2dc2864 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:02.515231 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-68b6730e-2607-4fa8-a243-eec0a2dc2864 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:02.522308 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-68b6730e-2607-4fa8-a243-eec0a2dc2864 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:02.523099 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-68b6730e-2607-4fa8-a243-eec0a2dc2864 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:02.524167 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-68b6730e-2607-4fa8-a243-eec0a2dc2864 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:02.524618 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-68b6730e-2607-4fa8-a243-eec0a2dc2864 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:02.715350 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-337c9efa-e7ae-439f-8dee-7bb6420f0f22 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:02.717271 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-337c9efa-e7ae-439f-8dee-7bb6420f0f22 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] [instance: 0a996f51-8f4d-4537-a941-aa692ff88bf8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:02.728716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-337c9efa-e7ae-439f-8dee-7bb6420f0f22 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:02.731778 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-337c9efa-e7ae-439f-8dee-7bb6420f0f22 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:02.732860 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-337c9efa-e7ae-439f-8dee-7bb6420f0f22 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:02.735162 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-337c9efa-e7ae-439f-8dee-7bb6420f0f22 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:02.771427 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-68b6730e-2607-4fa8-a243-eec0a2dc2864 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:02.785857 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-68b6730e-2607-4fa8-a243-eec0a2dc2864 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.288062 May 12 11:46:02.788916 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 82/158] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:02 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:03.007587 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-337c9efa-e7ae-439f-8dee-7bb6420f0f22 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29a589c1141436ba4c052ceff48a99f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c66c53d7c443749ee12d9c6478a8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:03.016123 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-337c9efa-e7ae-439f-8dee-7bb6420f0f22 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] 10.222.0.58 "GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8" status: 200 len: 1470 microversion: 2.1 time: 0.305371 May 12 11:46:03.025940 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 77/159] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:02 2022] GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8 => generated 1470 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:03.322134 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-d072d7ad-413f-4005-88b7-b78c1cd9a78e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Action: 'create', calling method: .version_select at 0x7f29f1faef70>, body: {"keypair": {"name": "tempest-keypair-248840448", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfUJDNc8qCS2nnBD4DGllTQC5jC2y3gz9ytzKgv8USFOCvHbEhrZcDB0OXOM37jkS5cjRhsTtIYprK2AF1mpsxVCEs/Tj3S7CRnr1zLNKCtuhX1C8wgJiaUEnjl6IMugA=="}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:46:03.335867 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-d072d7ad-413f-4005-88b7-b78c1cd9a78e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Getting quotas for project d51975fc708d49efa56621b0fd19c47f. Resources: {'key_pairs'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:46:03.339621 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-d072d7ad-413f-4005-88b7-b78c1cd9a78e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Getting quotas for user 97227abbbafa46f1b0660e3be2ceea70 and project d51975fc708d49efa56621b0fd19c47f. Resources: {'key_pairs'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:46:03.362176 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-d072d7ad-413f-4005-88b7-b78c1cd9a78e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.152726 May 12 11:46:03.362768 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 83/160] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 12 11:46:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:46:03.805081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-5604970b-b97e-479f-993c-e5c5f312b95f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:03.806909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-5604970b-b97e-479f-993c-e5c5f312b95f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:03.819214 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5604970b-b97e-479f-993c-e5c5f312b95f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:03.820343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5604970b-b97e-479f-993c-e5c5f312b95f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:03.822620 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5604970b-b97e-479f-993c-e5c5f312b95f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:03.823219 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5604970b-b97e-479f-993c-e5c5f312b95f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:04.035565 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-85ff5fbe-fed2-4014-97b0-a34df464d21e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:04.036768 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-85ff5fbe-fed2-4014-97b0-a34df464d21e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] [instance: 0a996f51-8f4d-4537-a941-aa692ff88bf8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:04.043904 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-85ff5fbe-fed2-4014-97b0-a34df464d21e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:04.044663 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-85ff5fbe-fed2-4014-97b0-a34df464d21e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:04.045907 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-85ff5fbe-fed2-4014-97b0-a34df464d21e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:04.046683 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-85ff5fbe-fed2-4014-97b0-a34df464d21e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:04.058377 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-5604970b-b97e-479f-993c-e5c5f312b95f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:04.077330 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-5604970b-b97e-479f-993c-e5c5f312b95f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.274966 May 12 11:46:04.080857 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 78/161] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:03 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:04.532315 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-85ff5fbe-fed2-4014-97b0-a34df464d21e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29a589c1141436ba4c052ceff48a99f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c66c53d7c443749ee12d9c6478a8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:04.544437 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-85ff5fbe-fed2-4014-97b0-a34df464d21e tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] 10.222.0.58 "GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8" status: 200 len: 1470 microversion: 2.1 time: 0.512753 May 12 11:46:04.546518 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 84/162] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:04 2022] GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8 => generated 1470 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:04.984963 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-920ed34c-ceee-48bc-b88d-413c7ecfe1a7 req-6b2f1524-eb00-4906-a5ec-3d345f27621a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a996f51-8f4d-4537-a941-aa692ff88bf8", "name": "network-vif-deleted", "tag": "87ba847e-ae2b-4b3f-9599-8f68310d239a"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:46:04.998640 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-920ed34c-ceee-48bc-b88d-413c7ecfe1a7 req-6b2f1524-eb00-4906-a5ec-3d345f27621a service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:05.000296 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-920ed34c-ceee-48bc-b88d-413c7ecfe1a7 req-6b2f1524-eb00-4906-a5ec-3d345f27621a service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:05.047123 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-920ed34c-ceee-48bc-b88d-413c7ecfe1a7 req-6b2f1524-eb00-4906-a5ec-3d345f27621a service nova] Creating event network-vif-deleted:87ba847e-ae2b-4b3f-9599-8f68310d239a for instance 0a996f51-8f4d-4537-a941-aa692ff88bf8 on hv-cinder-80473 May 12 11:46:05.062504 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-920ed34c-ceee-48bc-b88d-413c7ecfe1a7 req-6b2f1524-eb00-4906-a5ec-3d345f27621a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089781 May 12 11:46:05.063752 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 79/163] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:46:05.095721 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-0827872b-0d3a-41e1-8333-fd391683a06f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:05.096335 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-0827872b-0d3a-41e1-8333-fd391683a06f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:05.110043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0827872b-0d3a-41e1-8333-fd391683a06f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:05.115285 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0827872b-0d3a-41e1-8333-fd391683a06f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:05.116804 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0827872b-0d3a-41e1-8333-fd391683a06f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:05.118739 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0827872b-0d3a-41e1-8333-fd391683a06f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:05.183309 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-75210d7d-ecd0-4590-83a4-b4fb662117a5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-282058306", "imageRef": "576e8b7b-771b-47aa-89c6-ff04accc9bea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f747c31e-f2f6-4373-ba29-1719eaa22635"}], "security_groups": [{"name": "tempest-securitygroup--1470667163"}], "key_name": "tempest-keypair-248840448", "user_data": "}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:46:05.326031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-0827872b-0d3a-41e1-8333-fd391683a06f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:05.327165 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.network.neutron [None req-75210d7d-ecd0-4590-83a4-b4fb662117a5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] validate_networks() for [('f747c31e-f2f6-4373-ba29-1719eaa22635', None, None, None, None, None)] {{(pid=123508) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 11:46:05.334071 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-0827872b-0d3a-41e1-8333-fd391683a06f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.241960 May 12 11:46:05.335290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 85/164] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:05 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:05.571232 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-ee3b680c-712d-4da6-9e53-75b77fcdf34d tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:05.571975 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-ee3b680c-712d-4da6-9e53-75b77fcdf34d tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] [instance: 0a996f51-8f4d-4537-a941-aa692ff88bf8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:05.600619 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ee3b680c-712d-4da6-9e53-75b77fcdf34d tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:05.601121 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ee3b680c-712d-4da6-9e53-75b77fcdf34d tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:05.602002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ee3b680c-712d-4da6-9e53-75b77fcdf34d tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:05.607195 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ee3b680c-712d-4da6-9e53-75b77fcdf34d tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:05.680952 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ee3b680c-712d-4da6-9e53-75b77fcdf34d tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:05.688147 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ee3b680c-712d-4da6-9e53-75b77fcdf34d tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:05.691377 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.objects.instance [None req-ee3b680c-712d-4da6-9e53-75b77fcdf34d tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lazy-loading 'fault' on Instance uuid 0a996f51-8f4d-4537-a941-aa692ff88bf8 {{(pid=123507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:46:05.775735 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-ee3b680c-712d-4da6-9e53-75b77fcdf34d tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29a589c1141436ba4c052ceff48a99f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27c66c53d7c443749ee12d9c6478a8e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:05.783578 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-ee3b680c-712d-4da6-9e53-75b77fcdf34d tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] 10.222.0.58 "GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8" status: 200 len: 1305 microversion: 2.1 time: 0.216463 May 12 11:46:05.784584 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 86/165] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:05 2022] GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8 => generated 1305 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:05.907453 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-75210d7d-ecd0-4590-83a4-b4fb662117a5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Flavor limits 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 11:46:05.907881 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-75210d7d-ecd0-4590-83a4-b4fb662117a5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Image limits 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 11:46:05.908386 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-75210d7d-ecd0-4590-83a4-b4fb662117a5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Flavor pref 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 11:46:05.908992 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-75210d7d-ecd0-4590-83a4-b4fb662117a5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Image pref 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 11:46:05.909849 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-75210d7d-ecd0-4590-83a4-b4fb662117a5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 11:46:05.919289 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-75210d7d-ecd0-4590-83a4-b4fb662117a5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:05.920022 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-75210d7d-ecd0-4590-83a4-b4fb662117a5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:05.921013 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-75210d7d-ecd0-4590-83a4-b4fb662117a5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:05.921464 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-75210d7d-ecd0-4590-83a4-b4fb662117a5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:05.940067 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-75210d7d-ecd0-4590-83a4-b4fb662117a5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Getting quotas for project d51975fc708d49efa56621b0fd19c47f. Resources: {'ram', 'cores', 'instances'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:46:05.945020 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-75210d7d-ecd0-4590-83a4-b4fb662117a5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Getting quotas for user 97227abbbafa46f1b0660e3be2ceea70 and project d51975fc708d49efa56621b0fd19c47f. Resources: {'ram', 'cores', 'instances'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:46:05.970260 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-75210d7d-ecd0-4590-83a4-b4fb662117a5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Going to run 1 instances... {{(pid=123508) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 11:46:05.972682 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-75210d7d-ecd0-4590-83a4-b4fb662117a5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='576e8b7b-771b-47aa-89c6-ff04accc9bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 11:46:06.031254 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-75210d7d-ecd0-4590-83a4-b4fb662117a5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.853161 May 12 11:46:06.032670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 80/166] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 12 11:46:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 11:46:06.043960 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-cf726aad-2a87-4d32-9c85-dd777820264b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:06.044794 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-cf726aad-2a87-4d32-9c85-dd777820264b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:06.111724 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-cf726aad-2a87-4d32-9c85-dd777820264b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:06.120909 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-cf726aad-2a87-4d32-9c85-dd777820264b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1236 microversion: 2.1 time: 0.080942 May 12 11:46:06.131353 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 87/167] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:06 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1236 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:06.356445 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-7235c231-bd7b-44ee-8cff-a07478e75335 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:06.357297 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-7235c231-bd7b-44ee-8cff-a07478e75335 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:06.368945 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7235c231-bd7b-44ee-8cff-a07478e75335 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:06.369732 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7235c231-bd7b-44ee-8cff-a07478e75335 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:06.370721 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7235c231-bd7b-44ee-8cff-a07478e75335 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:06.373394 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7235c231-bd7b-44ee-8cff-a07478e75335 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:06.594712 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-7235c231-bd7b-44ee-8cff-a07478e75335 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:06.603538 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-7235c231-bd7b-44ee-8cff-a07478e75335 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.254509 May 12 11:46:06.609072 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 81/168] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:06 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:06.807434 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-aa3a70ae-a3dd-4825-be1d-1a684b1212a0 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:06.808048 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-aa3a70ae-a3dd-4825-be1d-1a684b1212a0 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] [instance: 0a996f51-8f4d-4537-a941-aa692ff88bf8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:06.826917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-aa3a70ae-a3dd-4825-be1d-1a684b1212a0 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:06.827705 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-aa3a70ae-a3dd-4825-be1d-1a684b1212a0 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:06.830832 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-aa3a70ae-a3dd-4825-be1d-1a684b1212a0 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:06.831399 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-aa3a70ae-a3dd-4825-be1d-1a684b1212a0 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:06.850781 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-aa3a70ae-a3dd-4825-be1d-1a684b1212a0 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] HTTP exception thrown: Instance 0a996f51-8f4d-4537-a941-aa692ff88bf8 could not be found. May 12 11:46:06.852538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-aa3a70ae-a3dd-4825-be1d-1a684b1212a0 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Request method failure captured: May 12 11:46:06.852538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8 HTTP/1.1 May 12 11:46:06.852538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:46:06.852538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:46:06.852538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:46:06.852538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 0 May 12 11:46:06.852538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:46:06.852538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:46:06.852538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:46:06.852538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:46:06.852538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPNlxG9uB8mL-BTJ-xzOvxXGadaIJPJHcaJlDV1y0E7JNI6rC1gF69-uF73Tdsu1VL262KPv3JWl8RpYXIy9uK0oIX_CeUqA4aXo6w8vGi6_h-mK8fhVgJgy5xNvAeXMllubPCC2NgKnHkbpuAHSjYE9N3sgP_Hx_QvQ93wxkqWjYpk May 12 11:46:06.852538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:46:06.852538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:46:06.852538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:46:06.852538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:46:06.852538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:46:06.852538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:46:06.852538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: 27c66c53d7c443749ee12d9c6478a8e3 May 12 11:46:06.852538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-VolumesNegativeTest-32887468 May 12 11:46:06.852538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:46:06.852538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:46:06.854086 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27c66c53d7c443749ee12d9c6478a8e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27c66c53d7c443749ee12d9c6478a8e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27c66c53d7c443749ee12d9c6478a8e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27c66c53d7c443749ee12d9c6478a8e3", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:46:06.854086 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-VolumesNegativeTest-32887468 May 12 11:46:06.854086 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: 27c66c53d7c443749ee12d9c6478a8e3 May 12 11:46:06.854086 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-VolumesNegativeTest-32887468 May 12 11:46:06.854086 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-VolumesNegativeTest-32887468-project May 12 11:46:06.854086 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:46:06.854086 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:46:06.854086 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: a29a589c1141436ba4c052ceff48a99f May 12 11:46:06.854086 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-VolumesNegativeTest-32887468-project May 12 11:46:06.854086 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: > May 12 11:46:06.854086 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Instance 0a996f51-8f4d-4537-a941-aa692ff88bf8 could not be found. May 12 11:46:06.854086 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'id': '0a996f51-8f4d-4537-a941-aa692ff88bf8'} May 12 11:46:06.855324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:46:06.855324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:46:06.855324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:46:06.855324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:46:06.855324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:46:06.855324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:46:06.855324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:46:06.855324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:46:06.855324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:46:06.855324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:46:06.855324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a996f51-8f4d-4537-a941-aa692ff88bf8 could not be found. May 12 11:46:06.855324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:46:06.855324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:46:06.855324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:46:06.855324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:46:06.855324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:46:06.855324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:46:06.855324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:46:06.855324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:46:06.855324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:46:06.857158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:46:06.857158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:46:06.857158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:46:06.857158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:46:06.857158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:46:06.857158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:46:06.857158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:46:06.857158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a996f51-8f4d-4537-a941-aa692ff88bf8 could not be found. May 12 11:46:06.857158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:46:06.857158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:46:06.857158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:46:06.857158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:46:06.857158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:46:06.857158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:46:06.857158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:46:06.857158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:46:06.857158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a996f51-8f4d-4537-a941-aa692ff88bf8 could not be found. May 12 11:46:06.857158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:46:06.858343 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-aa3a70ae-a3dd-4825-be1d-1a684b1212a0 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] Returning 404 to user: Instance 0a996f51-8f4d-4537-a941-aa692ff88bf8 could not be found. {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:46:06.859548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-aa3a70ae-a3dd-4825-be1d-1a684b1212a0 tempest-VolumesNegativeTest-32887468 tempest-VolumesNegativeTest-32887468-project] 10.222.0.58 "GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8" status: 404 len: 111 microversion: 2.1 time: 0.056055 May 12 11:46:06.865639 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 88/169] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:06 2022] GET /compute/v2.1/servers/0a996f51-8f4d-4537-a941-aa692ff88bf8 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:46:07.144466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-8535ea18-4be4-4950-9465-6e6595ed77e2 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:07.145872 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-8535ea18-4be4-4950-9465-6e6595ed77e2 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:07.155411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8535ea18-4be4-4950-9465-6e6595ed77e2 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:07.156217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8535ea18-4be4-4950-9465-6e6595ed77e2 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:07.157304 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8535ea18-4be4-4950-9465-6e6595ed77e2 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:07.158093 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8535ea18-4be4-4950-9465-6e6595ed77e2 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:07.268351 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8535ea18-4be4-4950-9465-6e6595ed77e2 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:07.279149 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-8535ea18-4be4-4950-9465-6e6595ed77e2 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1288 microversion: 2.1 time: 0.139361 May 12 11:46:07.281664 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 82/170] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:07 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1288 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:07.621813 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-ff351f50-9cf2-4e66-9d13-f33c7f7acb2a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:07.624577 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-ff351f50-9cf2-4e66-9d13-f33c7f7acb2a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:07.640499 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ff351f50-9cf2-4e66-9d13-f33c7f7acb2a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:07.641246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ff351f50-9cf2-4e66-9d13-f33c7f7acb2a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:07.642534 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ff351f50-9cf2-4e66-9d13-f33c7f7acb2a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:07.643169 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ff351f50-9cf2-4e66-9d13-f33c7f7acb2a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:07.885750 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-ff351f50-9cf2-4e66-9d13-f33c7f7acb2a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:07.896549 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-ff351f50-9cf2-4e66-9d13-f33c7f7acb2a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.279487 May 12 11:46:07.897328 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 89/171] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:07 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:08.296757 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-fdffbecb-08b8-47c6-87f2-005892c5ec5e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:08.298092 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-fdffbecb-08b8-47c6-87f2-005892c5ec5e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:08.305169 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fdffbecb-08b8-47c6-87f2-005892c5ec5e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:08.305966 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fdffbecb-08b8-47c6-87f2-005892c5ec5e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:08.306961 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fdffbecb-08b8-47c6-87f2-005892c5ec5e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:08.307609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fdffbecb-08b8-47c6-87f2-005892c5ec5e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:08.418065 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-fdffbecb-08b8-47c6-87f2-005892c5ec5e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:08.443991 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-fdffbecb-08b8-47c6-87f2-005892c5ec5e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1294 microversion: 2.1 time: 0.152158 May 12 11:46:08.444594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 83/172] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:08 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1294 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:08.915697 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-bea0be67-b853-4637-93dd-2a241ef314e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:08.916591 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-bea0be67-b853-4637-93dd-2a241ef314e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:08.926920 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bea0be67-b853-4637-93dd-2a241ef314e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:08.927623 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bea0be67-b853-4637-93dd-2a241ef314e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:08.928630 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bea0be67-b853-4637-93dd-2a241ef314e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:08.929212 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bea0be67-b853-4637-93dd-2a241ef314e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:09.212470 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-bea0be67-b853-4637-93dd-2a241ef314e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:09.225989 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-bea0be67-b853-4637-93dd-2a241ef314e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.315816 May 12 11:46:09.227176 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 90/173] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:08 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:09.474634 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b7627d59-1f00-4110-98c0-d6bf5b595fb6 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:09.475256 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-b7627d59-1f00-4110-98c0-d6bf5b595fb6 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:09.482116 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b7627d59-1f00-4110-98c0-d6bf5b595fb6 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:09.482817 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b7627d59-1f00-4110-98c0-d6bf5b595fb6 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:09.483781 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b7627d59-1f00-4110-98c0-d6bf5b595fb6 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:09.484434 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b7627d59-1f00-4110-98c0-d6bf5b595fb6 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:09.675636 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b7627d59-1f00-4110-98c0-d6bf5b595fb6 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:09.684723 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-b7627d59-1f00-4110-98c0-d6bf5b595fb6 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1362 microversion: 2.1 time: 0.227294 May 12 11:46:09.687508 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 84/174] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:09 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:10.216683 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-17429373-4e3f-4959-afca-db6ace23506d req-ac113316-0339-40b8-8aad-fe2e1c40a30c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bf4fa9e-950e-4be3-b042-517c2079c0f2", "tag": "2fe78454-40e0-452b-9fda-bc63a3a68799"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:46:10.228386 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-17429373-4e3f-4959-afca-db6ace23506d req-ac113316-0339-40b8-8aad-fe2e1c40a30c service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:10.229561 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-17429373-4e3f-4959-afca-db6ace23506d req-ac113316-0339-40b8-8aad-fe2e1c40a30c service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:10.245465 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-9bb9cb6b-d93c-4fe5-9ba4-c2eca16be74f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:10.246754 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-9bb9cb6b-d93c-4fe5-9ba4-c2eca16be74f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:10.261651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9bb9cb6b-d93c-4fe5-9ba4-c2eca16be74f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:10.263898 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9bb9cb6b-d93c-4fe5-9ba4-c2eca16be74f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:10.264901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9bb9cb6b-d93c-4fe5-9ba4-c2eca16be74f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:10.266094 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9bb9cb6b-d93c-4fe5-9ba4-c2eca16be74f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:10.266631 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-17429373-4e3f-4959-afca-db6ace23506d req-ac113316-0339-40b8-8aad-fe2e1c40a30c service nova] Creating event network-changed:2fe78454-40e0-452b-9fda-bc63a3a68799 for instance 6bf4fa9e-950e-4be3-b042-517c2079c0f2 on hv-cinder-80473 May 12 11:46:10.279044 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-17429373-4e3f-4959-afca-db6ace23506d req-ac113316-0339-40b8-8aad-fe2e1c40a30c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065855 May 12 11:46:10.287540 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 91/175] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:46:10.538946 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-9bb9cb6b-d93c-4fe5-9ba4-c2eca16be74f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:10.547294 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-9bb9cb6b-d93c-4fe5-9ba4-c2eca16be74f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.307419 May 12 11:46:10.565450 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 85/176] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:10 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:10.705438 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-45b58e55-cfd8-4f75-a042-311f01e7fdd8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:10.706275 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-45b58e55-cfd8-4f75-a042-311f01e7fdd8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:10.713634 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-45b58e55-cfd8-4f75-a042-311f01e7fdd8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:10.714565 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-45b58e55-cfd8-4f75-a042-311f01e7fdd8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:10.715558 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-45b58e55-cfd8-4f75-a042-311f01e7fdd8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:10.716142 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-45b58e55-cfd8-4f75-a042-311f01e7fdd8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:11.176055 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-45b58e55-cfd8-4f75-a042-311f01e7fdd8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:11.183937 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-45b58e55-cfd8-4f75-a042-311f01e7fdd8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1362 microversion: 2.1 time: 0.482571 May 12 11:46:11.187218 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 92/177] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:10 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1362 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:11.565417 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-61823a8a-c026-4610-9389-b088b511d33a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:11.566665 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-61823a8a-c026-4610-9389-b088b511d33a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:11.575538 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-61823a8a-c026-4610-9389-b088b511d33a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:11.581871 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-61823a8a-c026-4610-9389-b088b511d33a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:11.583132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-61823a8a-c026-4610-9389-b088b511d33a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:11.583751 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-61823a8a-c026-4610-9389-b088b511d33a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:11.992424 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-61823a8a-c026-4610-9389-b088b511d33a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:12.025222 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-61823a8a-c026-4610-9389-b088b511d33a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.464252 May 12 11:46:12.026766 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 86/178] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:11 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:12.202063 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-cddab7c0-2963-4e02-b9a9-ac9fc9771a49 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:12.203442 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-cddab7c0-2963-4e02-b9a9-ac9fc9771a49 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:12.210723 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cddab7c0-2963-4e02-b9a9-ac9fc9771a49 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:12.211395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cddab7c0-2963-4e02-b9a9-ac9fc9771a49 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:12.212302 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cddab7c0-2963-4e02-b9a9-ac9fc9771a49 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:12.212888 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cddab7c0-2963-4e02-b9a9-ac9fc9771a49 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:12.426671 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-cddab7c0-2963-4e02-b9a9-ac9fc9771a49 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:12.436258 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-cddab7c0-2963-4e02-b9a9-ac9fc9771a49 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1362 microversion: 2.1 time: 0.239586 May 12 11:46:12.437137 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 93/179] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:12 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:13.048420 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-34d746cd-d6c2-45f3-9a7f-604f43215699 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:13.049969 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-34d746cd-d6c2-45f3-9a7f-604f43215699 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:13.058249 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-34d746cd-d6c2-45f3-9a7f-604f43215699 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:13.062098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-34d746cd-d6c2-45f3-9a7f-604f43215699 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:13.063234 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-34d746cd-d6c2-45f3-9a7f-604f43215699 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:13.064597 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-34d746cd-d6c2-45f3-9a7f-604f43215699 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:13.244538 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-34d746cd-d6c2-45f3-9a7f-604f43215699 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:13.252568 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-34d746cd-d6c2-45f3-9a7f-604f43215699 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.211307 May 12 11:46:13.253146 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 87/180] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:13 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:13.452297 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-045d71eb-3aaf-4ba2-af40-9b28c46a7acb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:13.452881 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-045d71eb-3aaf-4ba2-af40-9b28c46a7acb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:13.459605 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-045d71eb-3aaf-4ba2-af40-9b28c46a7acb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:13.463191 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-045d71eb-3aaf-4ba2-af40-9b28c46a7acb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:13.463191 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-045d71eb-3aaf-4ba2-af40-9b28c46a7acb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:13.463191 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-045d71eb-3aaf-4ba2-af40-9b28c46a7acb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:13.827254 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-045d71eb-3aaf-4ba2-af40-9b28c46a7acb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:13.842168 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-045d71eb-3aaf-4ba2-af40-9b28c46a7acb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1362 microversion: 2.1 time: 0.393781 May 12 11:46:13.842766 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 94/181] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:13 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1362 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:14.260324 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-e0e85ad7-fe2f-4e8b-9772-47be0b686cf5 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-6733558", "imageRef": "576e8b7b-771b-47aa-89c6-ff04accc9bea", "flavorRef": "452", "networks": [{"uuid": "0fad6d38-b010-47d8-87bd-73e6b812b078"}]}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:46:14.269934 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-f9645c18-52bd-49d3-900a-8810f227472c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:14.270886 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-f9645c18-52bd-49d3-900a-8810f227472c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:14.278179 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f9645c18-52bd-49d3-900a-8810f227472c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:14.278843 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f9645c18-52bd-49d3-900a-8810f227472c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:14.279787 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f9645c18-52bd-49d3-900a-8810f227472c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:14.280228 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f9645c18-52bd-49d3-900a-8810f227472c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:14.327934 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.network.neutron [None req-e0e85ad7-fe2f-4e8b-9772-47be0b686cf5 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] validate_networks() for [('0fad6d38-b010-47d8-87bd-73e6b812b078', None, None, None, None, None)] {{(pid=123508) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 11:46:14.475058 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-f9645c18-52bd-49d3-900a-8810f227472c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:14.485673 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-f9645c18-52bd-49d3-900a-8810f227472c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.220036 May 12 11:46:14.487282 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 95/182] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:14 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:14.751479 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-e0e85ad7-fe2f-4e8b-9772-47be0b686cf5 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Flavor limits 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 11:46:14.751907 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-e0e85ad7-fe2f-4e8b-9772-47be0b686cf5 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Image limits 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 11:46:14.752467 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-e0e85ad7-fe2f-4e8b-9772-47be0b686cf5 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Flavor pref 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 11:46:14.752872 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-e0e85ad7-fe2f-4e8b-9772-47be0b686cf5 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Image pref 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 11:46:14.753504 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-e0e85ad7-fe2f-4e8b-9772-47be0b686cf5 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 11:46:14.769579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e0e85ad7-fe2f-4e8b-9772-47be0b686cf5 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:14.770156 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e0e85ad7-fe2f-4e8b-9772-47be0b686cf5 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:14.770984 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e0e85ad7-fe2f-4e8b-9772-47be0b686cf5 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:14.771426 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e0e85ad7-fe2f-4e8b-9772-47be0b686cf5 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:14.801015 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-e0e85ad7-fe2f-4e8b-9772-47be0b686cf5 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Getting quotas for project d83add10bc914fa2b53b93c94671c2cd. Resources: {'ram', 'cores', 'instances'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:46:14.806373 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-e0e85ad7-fe2f-4e8b-9772-47be0b686cf5 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Getting quotas for user 47030b2f71c64e8884d1946f4ed2afdd and project d83add10bc914fa2b53b93c94671c2cd. Resources: {'ram', 'cores', 'instances'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:46:14.821337 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-e0e85ad7-fe2f-4e8b-9772-47be0b686cf5 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Going to run 1 instances... {{(pid=123508) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 11:46:14.823540 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-e0e85ad7-fe2f-4e8b-9772-47be0b686cf5 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='576e8b7b-771b-47aa-89c6-ff04accc9bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 11:46:14.860786 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-804bc9e2-e74a-4ec3-af05-cd7c6d859f57 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:14.862813 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-804bc9e2-e74a-4ec3-af05-cd7c6d859f57 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:14.884337 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-804bc9e2-e74a-4ec3-af05-cd7c6d859f57 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:14.885003 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-804bc9e2-e74a-4ec3-af05-cd7c6d859f57 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:14.886103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-804bc9e2-e74a-4ec3-af05-cd7c6d859f57 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:14.887736 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-804bc9e2-e74a-4ec3-af05-cd7c6d859f57 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:14.962119 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-e0e85ad7-fe2f-4e8b-9772-47be0b686cf5 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.705481 May 12 11:46:14.986436 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 88/183] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 12 11:46:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 11:46:15.019583 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-7b44fc2f-cadc-485d-9624-e5412eb52861 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:15.020434 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-7b44fc2f-cadc-485d-9624-e5412eb52861 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:15.125214 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-7b44fc2f-cadc-485d-9624-e5412eb52861 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:15.130865 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-804bc9e2-e74a-4ec3-af05-cd7c6d859f57 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:15.140147 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-804bc9e2-e74a-4ec3-af05-cd7c6d859f57 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1362 microversion: 2.1 time: 0.285168 May 12 11:46:15.147176 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-7b44fc2f-cadc-485d-9624-e5412eb52861 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f" status: 200 len: 1211 microversion: 2.1 time: 0.136566 May 12 11:46:15.149610 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 89/184] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:14 2022] GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f => generated 1211 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:15.150005 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 96/185] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:14 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:15.503516 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-986b45cb-5510-41c9-892c-998850e17c00 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:15.504144 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-986b45cb-5510-41c9-892c-998850e17c00 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:15.529886 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-986b45cb-5510-41c9-892c-998850e17c00 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:15.530357 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-986b45cb-5510-41c9-892c-998850e17c00 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:15.532135 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-986b45cb-5510-41c9-892c-998850e17c00 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:15.532588 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-986b45cb-5510-41c9-892c-998850e17c00 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:15.740281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-986b45cb-5510-41c9-892c-998850e17c00 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:15.749912 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-986b45cb-5510-41c9-892c-998850e17c00 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.250305 May 12 11:46:15.759467 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 90/186] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:15 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:16.160272 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-e985e073-9722-427c-98a6-227385878694 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:16.161384 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-e985e073-9722-427c-98a6-227385878694 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:16.170721 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-8697b229-9c53-4009-ab03-ac36eb336572 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:16.171897 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-8697b229-9c53-4009-ab03-ac36eb336572 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:16.176651 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e985e073-9722-427c-98a6-227385878694 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:16.177165 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e985e073-9722-427c-98a6-227385878694 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:16.178094 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e985e073-9722-427c-98a6-227385878694 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:16.178688 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e985e073-9722-427c-98a6-227385878694 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:16.179000 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8697b229-9c53-4009-ab03-ac36eb336572 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:16.179520 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8697b229-9c53-4009-ab03-ac36eb336572 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:16.180420 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8697b229-9c53-4009-ab03-ac36eb336572 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:16.181042 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8697b229-9c53-4009-ab03-ac36eb336572 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:16.269121 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8697b229-9c53-4009-ab03-ac36eb336572 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:16.278988 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-8697b229-9c53-4009-ab03-ac36eb336572 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f" status: 200 len: 1263 microversion: 2.1 time: 0.113874 May 12 11:46:16.279632 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 91/187] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:16 2022] GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f => generated 1263 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:16.323926 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-e985e073-9722-427c-98a6-227385878694 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:16.331987 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-e985e073-9722-427c-98a6-227385878694 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1362 microversion: 2.1 time: 0.179373 May 12 11:46:16.332687 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 97/188] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:16 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:16.768575 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-016b6991-9ad4-451f-90f6-cd812c999cbb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:16.770865 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-016b6991-9ad4-451f-90f6-cd812c999cbb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:16.782632 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-016b6991-9ad4-451f-90f6-cd812c999cbb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:16.784032 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-016b6991-9ad4-451f-90f6-cd812c999cbb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:16.785057 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-016b6991-9ad4-451f-90f6-cd812c999cbb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:16.785498 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-016b6991-9ad4-451f-90f6-cd812c999cbb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:17.055514 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-016b6991-9ad4-451f-90f6-cd812c999cbb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:17.068527 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-016b6991-9ad4-451f-90f6-cd812c999cbb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.305180 May 12 11:46:17.070368 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 92/189] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:16 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:17.303352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-b99ba902-d592-4347-942c-30caa3926413 req-4e909695-6e1a-47b9-8f14-8ffaa432453a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf4fa9e-950e-4be3-b042-517c2079c0f2", "name": "network-vif-plugged", "status": "completed", "tag": "2fe78454-40e0-452b-9fda-bc63a3a68799"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:46:17.305941 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-3baae999-b04e-4619-9a89-4ee6f286c2d3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:17.308232 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-3baae999-b04e-4619-9a89-4ee6f286c2d3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:17.323759 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-b99ba902-d592-4347-942c-30caa3926413 req-4e909695-6e1a-47b9-8f14-8ffaa432453a service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:17.328566 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3baae999-b04e-4619-9a89-4ee6f286c2d3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:17.332216 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-b99ba902-d592-4347-942c-30caa3926413 req-4e909695-6e1a-47b9-8f14-8ffaa432453a service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:17.332895 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3baae999-b04e-4619-9a89-4ee6f286c2d3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:17.335615 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3baae999-b04e-4619-9a89-4ee6f286c2d3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:17.339388 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3baae999-b04e-4619-9a89-4ee6f286c2d3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:17.382008 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-b99ba902-d592-4347-942c-30caa3926413 req-4e909695-6e1a-47b9-8f14-8ffaa432453a service nova] Creating event network-vif-plugged:2fe78454-40e0-452b-9fda-bc63a3a68799 for instance 6bf4fa9e-950e-4be3-b042-517c2079c0f2 on hv-cinder-80473 May 12 11:46:17.411724 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-b99ba902-d592-4347-942c-30caa3926413 req-4e909695-6e1a-47b9-8f14-8ffaa432453a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116020 May 12 11:46:17.423623 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 93/190] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:46:17.448469 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-24fc832c-84f0-4832-bd1c-7986e1ffa96e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:17.449357 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-24fc832c-84f0-4832-bd1c-7986e1ffa96e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:17.469763 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-24fc832c-84f0-4832-bd1c-7986e1ffa96e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:17.472982 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-24fc832c-84f0-4832-bd1c-7986e1ffa96e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:17.474067 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-24fc832c-84f0-4832-bd1c-7986e1ffa96e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:17.483335 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-24fc832c-84f0-4832-bd1c-7986e1ffa96e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:17.839716 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-3baae999-b04e-4619-9a89-4ee6f286c2d3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:17.851056 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-3baae999-b04e-4619-9a89-4ee6f286c2d3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f" status: 200 len: 1311 microversion: 2.1 time: 0.558123 May 12 11:46:17.852504 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 98/191] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:17 2022] GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f => generated 1311 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:17.857898 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-24fc832c-84f0-4832-bd1c-7986e1ffa96e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:17.867554 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-24fc832c-84f0-4832-bd1c-7986e1ffa96e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1362 microversion: 2.1 time: 0.442482 May 12 11:46:17.868465 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 94/192] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:17 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1362 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:18.087666 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-2a0fb731-1c4a-4f64-ad60-aeedbc4196a0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:18.088237 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-2a0fb731-1c4a-4f64-ad60-aeedbc4196a0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:18.098066 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2a0fb731-1c4a-4f64-ad60-aeedbc4196a0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:18.098518 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2a0fb731-1c4a-4f64-ad60-aeedbc4196a0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:18.099323 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2a0fb731-1c4a-4f64-ad60-aeedbc4196a0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:18.099770 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2a0fb731-1c4a-4f64-ad60-aeedbc4196a0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:18.327679 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-2a0fb731-1c4a-4f64-ad60-aeedbc4196a0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:18.340341 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-2a0fb731-1c4a-4f64-ad60-aeedbc4196a0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.256073 May 12 11:46:18.343801 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 99/193] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:18 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:18.618409 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-8c326b07-cfc2-45fe-8473-5538e52388b0 req-5ac1404e-e6f7-49c5-a680-636dd020ac4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef2fa82b-9115-483c-9403-b2ca5f83054f", "tag": "f0057743-61b8-4720-93df-6c3d6fd83ed5"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:46:18.628360 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-8c326b07-cfc2-45fe-8473-5538e52388b0 req-5ac1404e-e6f7-49c5-a680-636dd020ac4f service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:18.630181 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-8c326b07-cfc2-45fe-8473-5538e52388b0 req-5ac1404e-e6f7-49c5-a680-636dd020ac4f service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:18.644881 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-8c326b07-cfc2-45fe-8473-5538e52388b0 req-5ac1404e-e6f7-49c5-a680-636dd020ac4f service nova] Creating event network-changed:f0057743-61b8-4720-93df-6c3d6fd83ed5 for instance ef2fa82b-9115-483c-9403-b2ca5f83054f on hv-cinder-80473 May 12 11:46:18.649962 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-8c326b07-cfc2-45fe-8473-5538e52388b0 req-5ac1404e-e6f7-49c5-a680-636dd020ac4f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035467 May 12 11:46:18.650954 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 95/194] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:46:18.869766 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-fac8deca-da0b-4f42-a890-d2d635643d11 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:18.870533 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-fac8deca-da0b-4f42-a890-d2d635643d11 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:18.885032 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-20998935-5443-4edb-848b-0565ea366e24 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:18.885759 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-20998935-5443-4edb-848b-0565ea366e24 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:18.893922 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fac8deca-da0b-4f42-a890-d2d635643d11 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:18.894999 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fac8deca-da0b-4f42-a890-d2d635643d11 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:18.896335 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-20998935-5443-4edb-848b-0565ea366e24 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:18.896777 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-20998935-5443-4edb-848b-0565ea366e24 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:18.897542 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-20998935-5443-4edb-848b-0565ea366e24 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:18.898003 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-20998935-5443-4edb-848b-0565ea366e24 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:18.898367 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fac8deca-da0b-4f42-a890-d2d635643d11 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:18.901787 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fac8deca-da0b-4f42-a890-d2d635643d11 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:19.292129 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-fac8deca-da0b-4f42-a890-d2d635643d11 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:19.309318 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-fac8deca-da0b-4f42-a890-d2d635643d11 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f" status: 200 len: 1311 microversion: 2.1 time: 0.443137 May 12 11:46:19.309898 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 100/195] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:18 2022] GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f => generated 1311 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:19.333252 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-20998935-5443-4edb-848b-0565ea366e24 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:19.342508 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-20998935-5443-4edb-848b-0565ea366e24 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1362 microversion: 2.1 time: 0.461829 May 12 11:46:19.356829 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 96/196] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:18 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1362 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:19.360826 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-7c054553-d950-45a1-8054-90e89e1fecad tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:19.361438 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-7c054553-d950-45a1-8054-90e89e1fecad tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:19.370302 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7c054553-d950-45a1-8054-90e89e1fecad tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:19.370672 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7c054553-d950-45a1-8054-90e89e1fecad tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:19.372020 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7c054553-d950-45a1-8054-90e89e1fecad tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:19.372451 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7c054553-d950-45a1-8054-90e89e1fecad tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:20.019293 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-7c054553-d950-45a1-8054-90e89e1fecad tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:20.031612 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-7c054553-d950-45a1-8054-90e89e1fecad tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.674453 May 12 11:46:20.034890 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 101/197] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:19 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:20.326842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-bd756b9c-a97e-4bd7-95b7-3f6a2ce504fc tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:20.327460 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-bd756b9c-a97e-4bd7-95b7-3f6a2ce504fc tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:20.333691 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bd756b9c-a97e-4bd7-95b7-3f6a2ce504fc tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:20.334172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bd756b9c-a97e-4bd7-95b7-3f6a2ce504fc tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:20.335003 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bd756b9c-a97e-4bd7-95b7-3f6a2ce504fc tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:20.335437 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bd756b9c-a97e-4bd7-95b7-3f6a2ce504fc tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:20.363284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-2ddafac5-14b4-4fdd-aab0-b5aa2bc0916b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:20.364033 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-2ddafac5-14b4-4fdd-aab0-b5aa2bc0916b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:20.375336 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2ddafac5-14b4-4fdd-aab0-b5aa2bc0916b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:20.378611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2ddafac5-14b4-4fdd-aab0-b5aa2bc0916b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:20.379590 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2ddafac5-14b4-4fdd-aab0-b5aa2bc0916b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:20.381803 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2ddafac5-14b4-4fdd-aab0-b5aa2bc0916b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:20.528800 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-bd756b9c-a97e-4bd7-95b7-3f6a2ce504fc tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:20.538030 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-bd756b9c-a97e-4bd7-95b7-3f6a2ce504fc tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f" status: 200 len: 1311 microversion: 2.1 time: 0.214864 May 12 11:46:20.541754 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 97/198] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:20 2022] GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f => generated 1311 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:20.643556 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-2ddafac5-14b4-4fdd-aab0-b5aa2bc0916b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:20.651093 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-2ddafac5-14b4-4fdd-aab0-b5aa2bc0916b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1362 microversion: 2.1 time: 0.291817 May 12 11:46:20.652381 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 102/199] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:20 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1362 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:21.051570 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-c2dc6ddf-6a69-4169-96fc-f05fc13d7b53 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:21.053028 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-c2dc6ddf-6a69-4169-96fc-f05fc13d7b53 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:21.061991 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c2dc6ddf-6a69-4169-96fc-f05fc13d7b53 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:21.062885 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c2dc6ddf-6a69-4169-96fc-f05fc13d7b53 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:21.063932 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c2dc6ddf-6a69-4169-96fc-f05fc13d7b53 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:21.064595 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c2dc6ddf-6a69-4169-96fc-f05fc13d7b53 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:21.243552 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c2dc6ddf-6a69-4169-96fc-f05fc13d7b53 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:21.255238 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-c2dc6ddf-6a69-4169-96fc-f05fc13d7b53 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1521 microversion: 2.1 time: 0.207558 May 12 11:46:21.259496 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 98/200] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:21 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:21.554543 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-10896607-0f42-4f6f-9570-559a694116fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:21.556591 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-10896607-0f42-4f6f-9570-559a694116fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:21.569167 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-10896607-0f42-4f6f-9570-559a694116fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:21.570155 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-10896607-0f42-4f6f-9570-559a694116fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:21.571251 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-10896607-0f42-4f6f-9570-559a694116fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:21.572062 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-10896607-0f42-4f6f-9570-559a694116fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:21.670112 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-1b1e7e8f-e6c5-496c-bf33-f6dc5091f8ef tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:21.671038 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-1b1e7e8f-e6c5-496c-bf33-f6dc5091f8ef tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:21.679921 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1b1e7e8f-e6c5-496c-bf33-f6dc5091f8ef tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:21.680420 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1b1e7e8f-e6c5-496c-bf33-f6dc5091f8ef tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:21.681260 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1b1e7e8f-e6c5-496c-bf33-f6dc5091f8ef tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:21.681985 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1b1e7e8f-e6c5-496c-bf33-f6dc5091f8ef tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:21.893851 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-1b1e7e8f-e6c5-496c-bf33-f6dc5091f8ef tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:21.900636 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-10896607-0f42-4f6f-9570-559a694116fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:21.911736 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-10896607-0f42-4f6f-9570-559a694116fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f" status: 200 len: 1311 microversion: 2.1 time: 0.361207 May 12 11:46:21.914176 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 103/201] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:21 2022] GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f => generated 1311 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:21.922473 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-1b1e7e8f-e6c5-496c-bf33-f6dc5091f8ef tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1548 microversion: 2.1 time: 0.255658 May 12 11:46:21.923113 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 99/202] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:21 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1548 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:21.944949 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-5a537054-5cbc-4d7c-ad18-2f773c8c4414 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:21.945951 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-5a537054-5cbc-4d7c-ad18-2f773c8c4414 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:21.953197 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5a537054-5cbc-4d7c-ad18-2f773c8c4414 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:21.954996 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5a537054-5cbc-4d7c-ad18-2f773c8c4414 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:21.954996 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5a537054-5cbc-4d7c-ad18-2f773c8c4414 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:21.955757 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5a537054-5cbc-4d7c-ad18-2f773c8c4414 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:22.112035 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-5a537054-5cbc-4d7c-ad18-2f773c8c4414 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.172180 May 12 11:46:22.113156 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 104/203] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 12 11:46:21 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:46:22.278186 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-3bd24173-6c4c-4666-bb16-29ddf4176be1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:22.278801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-3bd24173-6c4c-4666-bb16-29ddf4176be1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:22.285927 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3bd24173-6c4c-4666-bb16-29ddf4176be1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:22.286383 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3bd24173-6c4c-4666-bb16-29ddf4176be1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:22.287170 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3bd24173-6c4c-4666-bb16-29ddf4176be1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:22.287612 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3bd24173-6c4c-4666-bb16-29ddf4176be1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:22.528999 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-3bd24173-6c4c-4666-bb16-29ddf4176be1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:22.537824 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-3bd24173-6c4c-4666-bb16-29ddf4176be1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1501 microversion: 2.1 time: 0.263551 May 12 11:46:22.545666 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 100/204] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:22 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1501 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:22.556679 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-0d1e5f68-f9d4-4ecd-8d73-534c04a74ccc tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:22.557306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-0d1e5f68-f9d4-4ecd-8d73-534c04a74ccc tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:22.564046 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0d1e5f68-f9d4-4ecd-8d73-534c04a74ccc tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:22.564505 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0d1e5f68-f9d4-4ecd-8d73-534c04a74ccc tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:22.565823 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0d1e5f68-f9d4-4ecd-8d73-534c04a74ccc tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:22.566505 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0d1e5f68-f9d4-4ecd-8d73-534c04a74ccc tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:22.931507 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-892219f8-e1c5-4722-8afb-224d9fd8e438 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:22.932574 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-892219f8-e1c5-4722-8afb-224d9fd8e438 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:22.948010 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-892219f8-e1c5-4722-8afb-224d9fd8e438 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:22.948502 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-892219f8-e1c5-4722-8afb-224d9fd8e438 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:22.952236 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-892219f8-e1c5-4722-8afb-224d9fd8e438 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:22.953897 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-892219f8-e1c5-4722-8afb-224d9fd8e438 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:23.378768 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-0d1e5f68-f9d4-4ecd-8d73-534c04a74ccc tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:23.390653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-0d1e5f68-f9d4-4ecd-8d73-534c04a74ccc tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1514 microversion: 2.1 time: 0.838075 May 12 11:46:23.391686 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 105/205] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:22 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1514 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:23.717623 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-892219f8-e1c5-4722-8afb-224d9fd8e438 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:23.727529 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-892219f8-e1c5-4722-8afb-224d9fd8e438 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f" status: 200 len: 1311 microversion: 2.1 time: 0.800574 May 12 11:46:23.728398 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 101/206] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:22 2022] GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f => generated 1311 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:24.515060 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-c109bd7f-b53c-4d4b-8d59-4ba8a62690b1 req-17012003-9721-4156-85c7-4b68fa1e5d6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bf4fa9e-950e-4be3-b042-517c2079c0f2", "tag": "2fe78454-40e0-452b-9fda-bc63a3a68799"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:46:24.535388 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-c109bd7f-b53c-4d4b-8d59-4ba8a62690b1 req-17012003-9721-4156-85c7-4b68fa1e5d6d service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:24.535837 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-c109bd7f-b53c-4d4b-8d59-4ba8a62690b1 req-17012003-9721-4156-85c7-4b68fa1e5d6d service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:24.554965 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-c109bd7f-b53c-4d4b-8d59-4ba8a62690b1 req-17012003-9721-4156-85c7-4b68fa1e5d6d service nova] Creating event network-changed:2fe78454-40e0-452b-9fda-bc63a3a68799 for instance 6bf4fa9e-950e-4be3-b042-517c2079c0f2 on hv-cinder-80473 May 12 11:46:24.568973 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-c109bd7f-b53c-4d4b-8d59-4ba8a62690b1 req-17012003-9721-4156-85c7-4b68fa1e5d6d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062842 May 12 11:46:24.570107 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 106/207] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:46:24.745291 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-5d16d3c7-fa3b-4ca3-aba5-a729c03379f3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:24.746559 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-5d16d3c7-fa3b-4ca3-aba5-a729c03379f3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:24.757943 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5d16d3c7-fa3b-4ca3-aba5-a729c03379f3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:24.758659 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5d16d3c7-fa3b-4ca3-aba5-a729c03379f3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:24.759636 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5d16d3c7-fa3b-4ca3-aba5-a729c03379f3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:24.761032 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5d16d3c7-fa3b-4ca3-aba5-a729c03379f3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:25.027978 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-5d16d3c7-fa3b-4ca3-aba5-a729c03379f3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:25.038707 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-5d16d3c7-fa3b-4ca3-aba5-a729c03379f3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f" status: 200 len: 1311 microversion: 2.1 time: 0.298056 May 12 11:46:25.048325 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 102/208] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:24 2022] GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f => generated 1311 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:26.055749 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-60e81020-0db9-4f8c-bdf0-d04a944f1043 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:26.056663 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-60e81020-0db9-4f8c-bdf0-d04a944f1043 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:26.077621 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-60e81020-0db9-4f8c-bdf0-d04a944f1043 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:26.080775 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-60e81020-0db9-4f8c-bdf0-d04a944f1043 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:26.081593 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-60e81020-0db9-4f8c-bdf0-d04a944f1043 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:26.082076 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-60e81020-0db9-4f8c-bdf0-d04a944f1043 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:26.415830 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-60e81020-0db9-4f8c-bdf0-d04a944f1043 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:26.423772 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-60e81020-0db9-4f8c-bdf0-d04a944f1043 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f" status: 200 len: 1311 microversion: 2.1 time: 0.372581 May 12 11:46:26.424442 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 107/209] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:26 2022] GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f => generated 1311 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:27.440443 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-88406d55-37b0-4ba5-849a-18faa24446eb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:27.441140 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-88406d55-37b0-4ba5-849a-18faa24446eb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:27.449624 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-88406d55-37b0-4ba5-849a-18faa24446eb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:27.450106 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-88406d55-37b0-4ba5-849a-18faa24446eb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:27.450900 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-88406d55-37b0-4ba5-849a-18faa24446eb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:27.451607 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-88406d55-37b0-4ba5-849a-18faa24446eb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:27.688957 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-88406d55-37b0-4ba5-849a-18faa24446eb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:27.697930 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-88406d55-37b0-4ba5-849a-18faa24446eb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f" status: 200 len: 1311 microversion: 2.1 time: 0.260146 May 12 11:46:27.698859 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 103/210] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:27 2022] GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f => generated 1311 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:28.295640 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-ccd5d57f-55b9-4689-885c-0ed49b87ae62 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:46:28.297322 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-ccd5d57f-55b9-4689-885c-0ed49b87ae62 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:28.312012 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ccd5d57f-55b9-4689-885c-0ed49b87ae62 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:28.312643 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ccd5d57f-55b9-4689-885c-0ed49b87ae62 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:28.313944 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ccd5d57f-55b9-4689-885c-0ed49b87ae62 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:28.315195 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ccd5d57f-55b9-4689-885c-0ed49b87ae62 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:28.339442 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.objects.instance [None req-ccd5d57f-55b9-4689-885c-0ed49b87ae62 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lazy-loading 'flavor' on Instance uuid 337fca44-29a2-43fd-bc5f-092ad95c83f8 {{(pid=123507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:46:28.433466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-ccd5d57f-55b9-4689-885c-0ed49b87ae62 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "POST /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8/action" status: 200 len: 32 microversion: 2.1 time: 0.141652 May 12 11:46:28.434519 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 108/211] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 12 11:46:28 2022] POST /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8/action => generated 32 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 11:46:28.443991 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-7f63307a-abed-46df-a1cd-4fc90c94dd8e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:28.445639 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-7f63307a-abed-46df-a1cd-4fc90c94dd8e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:28.453785 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7f63307a-abed-46df-a1cd-4fc90c94dd8e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:28.454675 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7f63307a-abed-46df-a1cd-4fc90c94dd8e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:28.455926 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7f63307a-abed-46df-a1cd-4fc90c94dd8e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:28.456962 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7f63307a-abed-46df-a1cd-4fc90c94dd8e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:28.618225 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-7f63307a-abed-46df-a1cd-4fc90c94dd8e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:28.628673 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-7f63307a-abed-46df-a1cd-4fc90c94dd8e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.188952 May 12 11:46:28.630350 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 104/212] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:28 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:28.727810 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-9023912a-8998-4753-b5de-5124dcc1ac1e tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:28.728753 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-9023912a-8998-4753-b5de-5124dcc1ac1e tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:28.739968 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9023912a-8998-4753-b5de-5124dcc1ac1e tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:28.740422 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9023912a-8998-4753-b5de-5124dcc1ac1e tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:28.743564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9023912a-8998-4753-b5de-5124dcc1ac1e tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:28.744787 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9023912a-8998-4753-b5de-5124dcc1ac1e tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:29.346909 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-9023912a-8998-4753-b5de-5124dcc1ac1e tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:29.361516 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-9023912a-8998-4753-b5de-5124dcc1ac1e tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f" status: 200 len: 1311 microversion: 2.1 time: 0.647900 May 12 11:46:29.371463 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 109/213] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:28 2022] GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f => generated 1311 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:29.647876 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a9fec206-6112-45aa-8a3a-c2edf3e2fbf7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:29.652374 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-a9fec206-6112-45aa-8a3a-c2edf3e2fbf7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:29.660603 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a9fec206-6112-45aa-8a3a-c2edf3e2fbf7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:29.661122 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a9fec206-6112-45aa-8a3a-c2edf3e2fbf7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:29.662092 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a9fec206-6112-45aa-8a3a-c2edf3e2fbf7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:29.662594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a9fec206-6112-45aa-8a3a-c2edf3e2fbf7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:29.809967 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-a9fec206-6112-45aa-8a3a-c2edf3e2fbf7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:29.820214 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-a9fec206-6112-45aa-8a3a-c2edf3e2fbf7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.176899 May 12 11:46:29.831660 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 105/214] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:29 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:30.378352 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-370fc0e1-8687-454b-8af7-98230f8b1959 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:30.378994 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-370fc0e1-8687-454b-8af7-98230f8b1959 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:30.385418 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-370fc0e1-8687-454b-8af7-98230f8b1959 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:30.386438 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-370fc0e1-8687-454b-8af7-98230f8b1959 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:30.387213 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-370fc0e1-8687-454b-8af7-98230f8b1959 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:30.387652 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-370fc0e1-8687-454b-8af7-98230f8b1959 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:30.541042 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-370fc0e1-8687-454b-8af7-98230f8b1959 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:30.548659 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-370fc0e1-8687-454b-8af7-98230f8b1959 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f" status: 200 len: 1311 microversion: 2.1 time: 0.173913 May 12 11:46:30.549442 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 110/215] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:30 2022] GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f => generated 1311 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:30.837849 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-083c0d67-2559-4cbc-af5e-0c42a717e646 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:30.840045 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-083c0d67-2559-4cbc-af5e-0c42a717e646 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:30.848633 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-083c0d67-2559-4cbc-af5e-0c42a717e646 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:30.849215 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-083c0d67-2559-4cbc-af5e-0c42a717e646 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:30.850054 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-083c0d67-2559-4cbc-af5e-0c42a717e646 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:30.850687 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-083c0d67-2559-4cbc-af5e-0c42a717e646 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:31.032613 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-083c0d67-2559-4cbc-af5e-0c42a717e646 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:31.055400 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-083c0d67-2559-4cbc-af5e-0c42a717e646 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.221334 May 12 11:46:31.065786 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 106/216] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:30 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:31.304344 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-7e459f12-5859-4a73-bab7-01cb8833f3db req-ee976baa-3842-47da-8e05-0f6e226cbc11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef2fa82b-9115-483c-9403-b2ca5f83054f", "name": "network-vif-plugged", "status": "completed", "tag": "f0057743-61b8-4720-93df-6c3d6fd83ed5"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:46:31.324147 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-7e459f12-5859-4a73-bab7-01cb8833f3db req-ee976baa-3842-47da-8e05-0f6e226cbc11 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:31.327914 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-7e459f12-5859-4a73-bab7-01cb8833f3db req-ee976baa-3842-47da-8e05-0f6e226cbc11 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:31.359265 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-7e459f12-5859-4a73-bab7-01cb8833f3db req-ee976baa-3842-47da-8e05-0f6e226cbc11 service nova] Creating event network-vif-plugged:f0057743-61b8-4720-93df-6c3d6fd83ed5 for instance ef2fa82b-9115-483c-9403-b2ca5f83054f on hv-cinder-80473 May 12 11:46:31.367085 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-7e459f12-5859-4a73-bab7-01cb8833f3db req-ee976baa-3842-47da-8e05-0f6e226cbc11 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067909 May 12 11:46:31.375831 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 111/217] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:46:31.567632 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-2eb2f334-f19d-4a07-bb71-27238db02352 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:31.568500 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-2eb2f334-f19d-4a07-bb71-27238db02352 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:31.575519 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2eb2f334-f19d-4a07-bb71-27238db02352 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:31.576582 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2eb2f334-f19d-4a07-bb71-27238db02352 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:31.577527 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2eb2f334-f19d-4a07-bb71-27238db02352 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:31.578228 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2eb2f334-f19d-4a07-bb71-27238db02352 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:31.818219 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-2eb2f334-f19d-4a07-bb71-27238db02352 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:31.828497 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-2eb2f334-f19d-4a07-bb71-27238db02352 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f" status: 200 len: 1311 microversion: 2.1 time: 0.265035 May 12 11:46:31.829331 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 107/218] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:31 2022] GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f => generated 1311 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:32.076764 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-ca5a68b4-5efa-4edf-9b41-ab2af420a158 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:32.078141 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-ca5a68b4-5efa-4edf-9b41-ab2af420a158 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:32.085789 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ca5a68b4-5efa-4edf-9b41-ab2af420a158 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:32.086448 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ca5a68b4-5efa-4edf-9b41-ab2af420a158 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:32.087393 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ca5a68b4-5efa-4edf-9b41-ab2af420a158 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:32.087988 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ca5a68b4-5efa-4edf-9b41-ab2af420a158 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:32.280460 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-ca5a68b4-5efa-4edf-9b41-ab2af420a158 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:32.289116 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-ca5a68b4-5efa-4edf-9b41-ab2af420a158 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.217053 May 12 11:46:32.289941 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 112/219] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:32 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:32.851412 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-74d04aea-b0ea-46f2-a68c-9b4cd1b1d62e tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:32.852924 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-74d04aea-b0ea-46f2-a68c-9b4cd1b1d62e tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:32.865204 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-74d04aea-b0ea-46f2-a68c-9b4cd1b1d62e tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:32.865958 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-74d04aea-b0ea-46f2-a68c-9b4cd1b1d62e tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:32.867092 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-74d04aea-b0ea-46f2-a68c-9b4cd1b1d62e tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:32.867681 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-74d04aea-b0ea-46f2-a68c-9b4cd1b1d62e tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:33.075437 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-74d04aea-b0ea-46f2-a68c-9b4cd1b1d62e tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:33.085351 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-74d04aea-b0ea-46f2-a68c-9b4cd1b1d62e tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f" status: 200 len: 1311 microversion: 2.1 time: 0.243674 May 12 11:46:33.086344 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 108/220] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:32 2022] GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f => generated 1311 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:33.313673 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-ccdaedf9-6b79-43c0-bac6-fa63513cf49f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:33.314952 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-ccdaedf9-6b79-43c0-bac6-fa63513cf49f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:33.335972 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ccdaedf9-6b79-43c0-bac6-fa63513cf49f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:33.344664 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ccdaedf9-6b79-43c0-bac6-fa63513cf49f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:33.345804 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ccdaedf9-6b79-43c0-bac6-fa63513cf49f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:33.346402 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ccdaedf9-6b79-43c0-bac6-fa63513cf49f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:33.568561 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-ccdaedf9-6b79-43c0-bac6-fa63513cf49f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:33.577659 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-ccdaedf9-6b79-43c0-bac6-fa63513cf49f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.268740 May 12 11:46:33.579962 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 113/221] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:33 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:34.103409 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-6fbb2a7a-0012-429d-ae8b-bc5498650f12 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:34.104023 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-6fbb2a7a-0012-429d-ae8b-bc5498650f12 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:34.114464 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6fbb2a7a-0012-429d-ae8b-bc5498650f12 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:34.115272 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6fbb2a7a-0012-429d-ae8b-bc5498650f12 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:34.116380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6fbb2a7a-0012-429d-ae8b-bc5498650f12 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:34.116946 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6fbb2a7a-0012-429d-ae8b-bc5498650f12 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:34.275924 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-6fbb2a7a-0012-429d-ae8b-bc5498650f12 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:34.285477 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-6fbb2a7a-0012-429d-ae8b-bc5498650f12 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f" status: 200 len: 1311 microversion: 2.1 time: 0.186423 May 12 11:46:34.287610 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 109/222] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:34 2022] GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f => generated 1311 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:34.595909 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-a9f5a86f-5216-45ff-b39e-78442fdb1877 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:34.596527 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-a9f5a86f-5216-45ff-b39e-78442fdb1877 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:34.612188 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a9f5a86f-5216-45ff-b39e-78442fdb1877 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:34.612891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a9f5a86f-5216-45ff-b39e-78442fdb1877 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:34.613908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a9f5a86f-5216-45ff-b39e-78442fdb1877 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:34.614499 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a9f5a86f-5216-45ff-b39e-78442fdb1877 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:34.798743 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-a9f5a86f-5216-45ff-b39e-78442fdb1877 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:34.808452 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-a9f5a86f-5216-45ff-b39e-78442fdb1877 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.215813 May 12 11:46:34.812658 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 114/223] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:34 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:35.304009 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-f21b76e1-0319-4e69-9061-afa844c14286 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:35.304786 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-f21b76e1-0319-4e69-9061-afa844c14286 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:35.311138 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f21b76e1-0319-4e69-9061-afa844c14286 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:35.311604 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f21b76e1-0319-4e69-9061-afa844c14286 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:35.312393 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f21b76e1-0319-4e69-9061-afa844c14286 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:35.312836 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f21b76e1-0319-4e69-9061-afa844c14286 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:35.456815 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-f21b76e1-0319-4e69-9061-afa844c14286 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:35.467265 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-f21b76e1-0319-4e69-9061-afa844c14286 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f" status: 200 len: 1311 microversion: 2.1 time: 0.167109 May 12 11:46:35.468183 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 110/224] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:35 2022] GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f => generated 1311 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:35.827553 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-5f5bccc0-1228-402b-b963-0cf9da37dfc9 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:35.828787 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-5f5bccc0-1228-402b-b963-0cf9da37dfc9 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:35.834921 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5f5bccc0-1228-402b-b963-0cf9da37dfc9 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:35.835372 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5f5bccc0-1228-402b-b963-0cf9da37dfc9 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:35.836165 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5f5bccc0-1228-402b-b963-0cf9da37dfc9 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:35.836595 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5f5bccc0-1228-402b-b963-0cf9da37dfc9 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:35.985675 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-5f5bccc0-1228-402b-b963-0cf9da37dfc9 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:35.993417 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-5f5bccc0-1228-402b-b963-0cf9da37dfc9 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.171494 May 12 11:46:36.002758 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 115/225] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:35 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:36.484269 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-3bdcd457-1b0b-4802-ba4a-0def27ca2f39 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:36.485097 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-3bdcd457-1b0b-4802-ba4a-0def27ca2f39 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:36.491389 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3bdcd457-1b0b-4802-ba4a-0def27ca2f39 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:36.491835 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3bdcd457-1b0b-4802-ba4a-0def27ca2f39 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:36.492631 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3bdcd457-1b0b-4802-ba4a-0def27ca2f39 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:36.493062 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3bdcd457-1b0b-4802-ba4a-0def27ca2f39 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:36.642174 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-3bdcd457-1b0b-4802-ba4a-0def27ca2f39 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:36.651077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-3bdcd457-1b0b-4802-ba4a-0def27ca2f39 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f" status: 200 len: 1496 microversion: 2.1 time: 0.170472 May 12 11:46:36.664165 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 111/226] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:36 2022] GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f => generated 1496 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:37.012463 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-92467ead-3f39-40aa-bbe0-e9f6f8067a14 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:37.014009 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-92467ead-3f39-40aa-bbe0-e9f6f8067a14 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:37.023575 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-92467ead-3f39-40aa-bbe0-e9f6f8067a14 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:37.024397 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-92467ead-3f39-40aa-bbe0-e9f6f8067a14 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:37.025444 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-92467ead-3f39-40aa-bbe0-e9f6f8067a14 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:37.026350 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-92467ead-3f39-40aa-bbe0-e9f6f8067a14 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:37.235185 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-92467ead-3f39-40aa-bbe0-e9f6f8067a14 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:37.244433 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-92467ead-3f39-40aa-bbe0-e9f6f8067a14 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.237373 May 12 11:46:37.245905 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 116/227] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:37 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:37.432410 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-411bbe18-1d67-45d5-a0f8-5e0ce84a2bc1 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:37.432972 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-411bbe18-1d67-45d5-a0f8-5e0ce84a2bc1 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:37.439373 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-411bbe18-1d67-45d5-a0f8-5e0ce84a2bc1 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:37.440013 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-411bbe18-1d67-45d5-a0f8-5e0ce84a2bc1 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:37.440971 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-411bbe18-1d67-45d5-a0f8-5e0ce84a2bc1 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:37.441554 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-411bbe18-1d67-45d5-a0f8-5e0ce84a2bc1 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:37.476619 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-411bbe18-1d67-45d5-a0f8-5e0ce84a2bc1 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] Going to try to terminate instance {{(pid=123508) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 11:46:37.580631 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-411bbe18-1d67-45d5-a0f8-5e0ce84a2bc1 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f" status: 204 len: 0 microversion: 2.1 time: 0.151700 May 12 11:46:37.582191 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 112/228] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:46:37 2022] DELETE /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 11:46:37.591294 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-903ee3f7-ce10-4993-8e12-279b7de238c2 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:37.594329 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-903ee3f7-ce10-4993-8e12-279b7de238c2 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:37.600836 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-903ee3f7-ce10-4993-8e12-279b7de238c2 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:37.601389 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-903ee3f7-ce10-4993-8e12-279b7de238c2 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:37.602290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-903ee3f7-ce10-4993-8e12-279b7de238c2 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:37.602820 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-903ee3f7-ce10-4993-8e12-279b7de238c2 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:37.763757 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-903ee3f7-ce10-4993-8e12-279b7de238c2 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:37.772026 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-903ee3f7-ce10-4993-8e12-279b7de238c2 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f" status: 200 len: 1502 microversion: 2.1 time: 0.185347 May 12 11:46:37.783877 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 117/229] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:37 2022] GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f => generated 1502 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:38.264896 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-6f334d2a-403a-4dd1-84a3-c794c94a78a3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:38.265989 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-6f334d2a-403a-4dd1-84a3-c794c94a78a3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:38.272533 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6f334d2a-403a-4dd1-84a3-c794c94a78a3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:38.273152 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6f334d2a-403a-4dd1-84a3-c794c94a78a3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:38.274174 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6f334d2a-403a-4dd1-84a3-c794c94a78a3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:38.274614 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6f334d2a-403a-4dd1-84a3-c794c94a78a3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:38.414849 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-6f334d2a-403a-4dd1-84a3-c794c94a78a3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:38.424383 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-6f334d2a-403a-4dd1-84a3-c794c94a78a3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.163665 May 12 11:46:38.438156 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 113/230] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:38 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:38.788765 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-188c5df5-b896-4753-843b-2f870fb89ddd tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:38.789370 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-188c5df5-b896-4753-843b-2f870fb89ddd tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:38.796270 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-188c5df5-b896-4753-843b-2f870fb89ddd tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:38.796723 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-188c5df5-b896-4753-843b-2f870fb89ddd tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:38.797498 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-188c5df5-b896-4753-843b-2f870fb89ddd tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:38.798101 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-188c5df5-b896-4753-843b-2f870fb89ddd tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:38.956196 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-188c5df5-b896-4753-843b-2f870fb89ddd tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:38.966108 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-188c5df5-b896-4753-843b-2f870fb89ddd tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f" status: 200 len: 1502 microversion: 2.1 time: 0.181484 May 12 11:46:38.967345 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 118/231] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:38 2022] GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f => generated 1502 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:39.444972 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-cd8175c0-52dd-4589-8bdc-34273a889462 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:39.446482 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-cd8175c0-52dd-4589-8bdc-34273a889462 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:39.455195 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cd8175c0-52dd-4589-8bdc-34273a889462 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:39.455730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cd8175c0-52dd-4589-8bdc-34273a889462 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:39.460725 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cd8175c0-52dd-4589-8bdc-34273a889462 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:39.461183 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cd8175c0-52dd-4589-8bdc-34273a889462 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:39.623978 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-cd8175c0-52dd-4589-8bdc-34273a889462 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:39.631836 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-cd8175c0-52dd-4589-8bdc-34273a889462 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.190624 May 12 11:46:39.632582 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 114/232] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:39 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:39.984859 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-83875541-3628-4c33-9e1a-0a4340b68a90 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:39.986115 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-83875541-3628-4c33-9e1a-0a4340b68a90 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:39.994553 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-83875541-3628-4c33-9e1a-0a4340b68a90 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:39.996278 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-83875541-3628-4c33-9e1a-0a4340b68a90 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:40.005771 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-83875541-3628-4c33-9e1a-0a4340b68a90 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:40.006249 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-83875541-3628-4c33-9e1a-0a4340b68a90 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:40.223338 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-83875541-3628-4c33-9e1a-0a4340b68a90 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:40.234080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-83875541-3628-4c33-9e1a-0a4340b68a90 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f" status: 200 len: 1502 microversion: 2.1 time: 0.253949 May 12 11:46:40.235227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 119/233] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:39 2022] GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f => generated 1502 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:40.336466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-33d96de7-7f43-4544-bad6-b550784db0fd req-a12ae95a-5526-4641-8957-03c42e2301ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef2fa82b-9115-483c-9403-b2ca5f83054f", "name": "network-vif-deleted", "tag": "f0057743-61b8-4720-93df-6c3d6fd83ed5"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:46:40.346577 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-33d96de7-7f43-4544-bad6-b550784db0fd req-a12ae95a-5526-4641-8957-03c42e2301ea service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:40.347019 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-33d96de7-7f43-4544-bad6-b550784db0fd req-a12ae95a-5526-4641-8957-03c42e2301ea service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:40.359479 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-33d96de7-7f43-4544-bad6-b550784db0fd req-a12ae95a-5526-4641-8957-03c42e2301ea service nova] Creating event network-vif-deleted:f0057743-61b8-4720-93df-6c3d6fd83ed5 for instance ef2fa82b-9115-483c-9403-b2ca5f83054f on hv-cinder-80473 May 12 11:46:40.364485 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-33d96de7-7f43-4544-bad6-b550784db0fd req-a12ae95a-5526-4641-8957-03c42e2301ea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033248 May 12 11:46:40.365288 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 115/234] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:46:40.369813 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-1cbad1dc-8649-4dd8-8027-cffb9f01adb1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Action: 'create', calling method: .version_select at 0x7f29f200f430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-466760655", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcy+6eb7g+F8cZzLLtvx6zCBBZkCQPyMUY+KYsBb6T7FJMBgra+AKxUlJZzeK5Z2ODQUNcWv2U8a+vnOVXIVFszRC+pyAMs1yCktEnQmi+osnP2M9nFfZeSKW43x6prDQ=="}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:46:40.383994 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-1cbad1dc-8649-4dd8-8027-cffb9f01adb1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Getting quotas for project 95636bf5a2284bc697044d2b3b46828a. Resources: {'key_pairs'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:46:40.387833 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-1cbad1dc-8649-4dd8-8027-cffb9f01adb1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Getting quotas for user 59c0922d8e2f4389a3aa4b6daa9d3d37 and project 95636bf5a2284bc697044d2b3b46828a. Resources: {'key_pairs'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:46:40.412049 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-1cbad1dc-8649-4dd8-8027-cffb9f01adb1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049489 May 12 11:46:40.412584 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 120/235] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 12 11:46:40 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:46:40.467221 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-d0d0fad2-127a-43ae-b6f7-ab8268bd880f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1750944486", "imageRef": "76658556-26d4-467e-9459-e8e2ce51ad81", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-466760655", "networks": [{"uuid": "98824664-61dd-44ab-8bd0-7c8c51299b91"}]}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:46:40.521658 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.network.neutron [None req-d0d0fad2-127a-43ae-b6f7-ab8268bd880f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] validate_networks() for [('98824664-61dd-44ab-8bd0-7c8c51299b91', None, None, None, None, None)] {{(pid=123508) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 11:46:40.651923 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-e752f0d4-0425-4a4a-a515-5c1c41c89f1c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:40.652724 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-e752f0d4-0425-4a4a-a515-5c1c41c89f1c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:40.660122 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e752f0d4-0425-4a4a-a515-5c1c41c89f1c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:40.660603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e752f0d4-0425-4a4a-a515-5c1c41c89f1c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:40.661487 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e752f0d4-0425-4a4a-a515-5c1c41c89f1c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:40.661955 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e752f0d4-0425-4a4a-a515-5c1c41c89f1c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:40.790730 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-e752f0d4-0425-4a4a-a515-5c1c41c89f1c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:40.798017 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-e752f0d4-0425-4a4a-a515-5c1c41c89f1c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.151251 May 12 11:46:40.798588 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 121/236] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:40 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:40.889282 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-d0d0fad2-127a-43ae-b6f7-ab8268bd880f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Flavor limits 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 11:46:40.889725 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-d0d0fad2-127a-43ae-b6f7-ab8268bd880f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Image limits 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 11:46:40.890356 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-d0d0fad2-127a-43ae-b6f7-ab8268bd880f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Flavor pref 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 11:46:40.890764 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-d0d0fad2-127a-43ae-b6f7-ab8268bd880f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Image pref 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 11:46:40.891281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-d0d0fad2-127a-43ae-b6f7-ab8268bd880f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 11:46:40.901969 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d0d0fad2-127a-43ae-b6f7-ab8268bd880f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:40.902384 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d0d0fad2-127a-43ae-b6f7-ab8268bd880f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:40.903393 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d0d0fad2-127a-43ae-b6f7-ab8268bd880f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:40.904062 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d0d0fad2-127a-43ae-b6f7-ab8268bd880f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:40.924917 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-d0d0fad2-127a-43ae-b6f7-ab8268bd880f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Getting quotas for project 95636bf5a2284bc697044d2b3b46828a. Resources: {'ram', 'cores', 'instances'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:46:40.928515 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-d0d0fad2-127a-43ae-b6f7-ab8268bd880f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Getting quotas for user 59c0922d8e2f4389a3aa4b6daa9d3d37 and project 95636bf5a2284bc697044d2b3b46828a. Resources: {'ram', 'cores', 'instances'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:46:40.940284 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d0d0fad2-127a-43ae-b6f7-ab8268bd880f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Going to run 1 instances... {{(pid=123508) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 11:46:40.942627 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d0d0fad2-127a-43ae-b6f7-ab8268bd880f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='76658556-26d4-467e-9459-e8e2ce51ad81',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 11:46:40.993485 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-d0d0fad2-127a-43ae-b6f7-ab8268bd880f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535381 May 12 11:46:40.994186 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 116/237] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 12 11:46:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 11:46:41.004213 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-e4b7006c-d663-4a9b-99b1-a79beb825d11 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:41.005614 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-e4b7006c-d663-4a9b-99b1-a79beb825d11 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:41.078864 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-e4b7006c-d663-4a9b-99b1-a79beb825d11 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:41.085676 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-e4b7006c-d663-4a9b-99b1-a79beb825d11 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1258 microversion: 2.1 time: 0.085693 May 12 11:46:41.086493 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 122/238] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:40 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1258 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:41.250965 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ea7d5801-cc78-45de-91b5-4fd7a64a634c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:41.251505 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-ea7d5801-cc78-45de-91b5-4fd7a64a634c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: ef2fa82b-9115-483c-9403-b2ca5f83054f] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:41.259170 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ea7d5801-cc78-45de-91b5-4fd7a64a634c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:41.259620 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ea7d5801-cc78-45de-91b5-4fd7a64a634c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:41.260414 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ea7d5801-cc78-45de-91b5-4fd7a64a634c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:41.261373 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ea7d5801-cc78-45de-91b5-4fd7a64a634c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:41.276152 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-ea7d5801-cc78-45de-91b5-4fd7a64a634c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] HTTP exception thrown: Instance ef2fa82b-9115-483c-9403-b2ca5f83054f could not be found. May 12 11:46:41.278136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ea7d5801-cc78-45de-91b5-4fd7a64a634c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Request method failure captured: May 12 11:46:41.278136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f HTTP/1.1 May 12 11:46:41.278136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:46:41.278136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:46:41.278136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:46:41.278136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:46:41.278136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:46:41.278136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:46:41.278136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:46:41.278136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:46:41.278136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPOEO2pEgawQFSjLu40R7oRIsR0-Kocm6DBcQebK5c5CAINFizDYZfqdmzT8Hf49zQ6T_xrJIJEYX1LY5Mhp4o1p4BQFPMzlzZ8buDioIy_wVTatps4wrgAggrUTpYqb1rVqmllJ84t_gLPewzK7FpaqNq5ZUg3EX9As5i_xj83SDIQ May 12 11:46:41.278136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:46:41.278136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:46:41.278136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:46:41.278136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:46:41.278136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:46:41.278136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:46:41.278136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: d83add10bc914fa2b53b93c94671c2cd May 12 11:46:41.278136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-VolumesActionsTest-1409713188 May 12 11:46:41.278136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:46:41.278136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:46:41.279685 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d83add10bc914fa2b53b93c94671c2cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d83add10bc914fa2b53b93c94671c2cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d83add10bc914fa2b53b93c94671c2cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d83add10bc914fa2b53b93c94671c2cd", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:46:41.279685 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-VolumesActionsTest-1409713188 May 12 11:46:41.279685 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: d83add10bc914fa2b53b93c94671c2cd May 12 11:46:41.279685 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-VolumesActionsTest-1409713188 May 12 11:46:41.279685 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-VolumesActionsTest-1409713188-project May 12 11:46:41.279685 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:46:41.279685 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:46:41.279685 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 47030b2f71c64e8884d1946f4ed2afdd May 12 11:46:41.279685 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-VolumesActionsTest-1409713188-project May 12 11:46:41.279685 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:46:41.279685 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance ef2fa82b-9115-483c-9403-b2ca5f83054f could not be found. May 12 11:46:41.279685 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': 'ef2fa82b-9115-483c-9403-b2ca5f83054f'} May 12 11:46:41.280609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:46:41.280609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:46:41.280609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:46:41.280609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:46:41.280609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:46:41.280609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:46:41.280609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:46:41.280609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:46:41.280609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:46:41.280609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:46:41.280609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef2fa82b-9115-483c-9403-b2ca5f83054f could not be found. May 12 11:46:41.280609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:46:41.280609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:46:41.280609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:46:41.280609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:46:41.280609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:46:41.280609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:46:41.280609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:46:41.280609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:46:41.280609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:46:41.281919 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:46:41.281919 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:46:41.281919 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:46:41.281919 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:46:41.281919 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:46:41.281919 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:46:41.281919 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:46:41.281919 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef2fa82b-9115-483c-9403-b2ca5f83054f could not be found. May 12 11:46:41.281919 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:46:41.281919 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:46:41.281919 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:46:41.281919 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:46:41.281919 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:46:41.281919 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:46:41.281919 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:46:41.281919 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:46:41.281919 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef2fa82b-9115-483c-9403-b2ca5f83054f could not be found. May 12 11:46:41.281919 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:46:41.286669 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ea7d5801-cc78-45de-91b5-4fd7a64a634c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Returning 404 to user: Instance ef2fa82b-9115-483c-9403-b2ca5f83054f could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:46:41.286669 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-ea7d5801-cc78-45de-91b5-4fd7a64a634c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f" status: 404 len: 111 microversion: 2.1 time: 0.032764 May 12 11:46:41.286669 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 117/239] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:41 2022] GET /compute/v2.1/servers/ef2fa82b-9115-483c-9403-b2ca5f83054f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:46:41.383960 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-967a9f26-9852-4853-bc21-b4611dc9bb05 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1107046787", "imageRef": "576e8b7b-771b-47aa-89c6-ff04accc9bea", "flavorRef": "452", "networks": [{"uuid": "0fad6d38-b010-47d8-87bd-73e6b812b078"}]}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:46:41.438472 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.network.neutron [None req-967a9f26-9852-4853-bc21-b4611dc9bb05 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] validate_networks() for [('0fad6d38-b010-47d8-87bd-73e6b812b078', None, None, None, None, None)] {{(pid=123507) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 11:46:41.789584 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-967a9f26-9852-4853-bc21-b4611dc9bb05 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Flavor limits 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 11:46:41.790048 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-967a9f26-9852-4853-bc21-b4611dc9bb05 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Image limits 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 11:46:41.790522 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-967a9f26-9852-4853-bc21-b4611dc9bb05 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Flavor pref 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 11:46:41.790940 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-967a9f26-9852-4853-bc21-b4611dc9bb05 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Image pref 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 11:46:41.791357 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-967a9f26-9852-4853-bc21-b4611dc9bb05 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 11:46:41.800542 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-967a9f26-9852-4853-bc21-b4611dc9bb05 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:41.800991 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-967a9f26-9852-4853-bc21-b4611dc9bb05 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:41.801843 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-967a9f26-9852-4853-bc21-b4611dc9bb05 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:41.802283 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-967a9f26-9852-4853-bc21-b4611dc9bb05 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:41.814539 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-903bf852-8593-439d-88cc-e752c1742e84 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:41.815696 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-903bf852-8593-439d-88cc-e752c1742e84 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:41.819400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-967a9f26-9852-4853-bc21-b4611dc9bb05 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Getting quotas for project d83add10bc914fa2b53b93c94671c2cd. Resources: {'ram', 'cores', 'instances'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:46:41.821483 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-903bf852-8593-439d-88cc-e752c1742e84 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:41.821964 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-903bf852-8593-439d-88cc-e752c1742e84 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:41.822732 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-903bf852-8593-439d-88cc-e752c1742e84 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:41.823167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-903bf852-8593-439d-88cc-e752c1742e84 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:41.823336 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-967a9f26-9852-4853-bc21-b4611dc9bb05 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Getting quotas for user 47030b2f71c64e8884d1946f4ed2afdd and project d83add10bc914fa2b53b93c94671c2cd. Resources: {'ram', 'cores', 'instances'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:46:41.834492 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-967a9f26-9852-4853-bc21-b4611dc9bb05 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Going to run 1 instances... {{(pid=123507) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 11:46:41.836845 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-967a9f26-9852-4853-bc21-b4611dc9bb05 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='576e8b7b-771b-47aa-89c6-ff04accc9bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123507) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 11:46:41.886675 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-967a9f26-9852-4853-bc21-b4611dc9bb05 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.507039 May 12 11:46:41.887558 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 123/240] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 12 11:46:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 11:46:41.898264 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-2a87a9d5-d67a-4f4e-b201-b82f985ddb89 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:41.898865 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-2a87a9d5-d67a-4f4e-b201-b82f985ddb89 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:41.965836 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-2a87a9d5-d67a-4f4e-b201-b82f985ddb89 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:41.972551 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-903bf852-8593-439d-88cc-e752c1742e84 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:41.973519 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-2a87a9d5-d67a-4f4e-b201-b82f985ddb89 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1214 microversion: 2.1 time: 0.078834 May 12 11:46:41.974214 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 124/241] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:41 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:41.980344 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-903bf852-8593-439d-88cc-e752c1742e84 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.169582 May 12 11:46:41.981130 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 118/242] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:41 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:42.103966 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-560418a4-25ed-4f8d-a7b8-e2ab2ce82181 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:42.105024 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-560418a4-25ed-4f8d-a7b8-e2ab2ce82181 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:42.114929 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-560418a4-25ed-4f8d-a7b8-e2ab2ce82181 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:42.116290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-560418a4-25ed-4f8d-a7b8-e2ab2ce82181 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:42.118092 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-560418a4-25ed-4f8d-a7b8-e2ab2ce82181 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:42.118855 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-560418a4-25ed-4f8d-a7b8-e2ab2ce82181 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:42.225522 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-560418a4-25ed-4f8d-a7b8-e2ab2ce82181 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:42.234806 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-560418a4-25ed-4f8d-a7b8-e2ab2ce82181 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1318 microversion: 2.1 time: 0.135159 May 12 11:46:42.237300 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 125/243] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:42 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:42.272116 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-d673ebd6-a916-4ae2-b4a2-b14d94aa9653 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:42.272867 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d673ebd6-a916-4ae2-b4a2-b14d94aa9653 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:42.286770 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d673ebd6-a916-4ae2-b4a2-b14d94aa9653 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:42.287219 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d673ebd6-a916-4ae2-b4a2-b14d94aa9653 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:42.287980 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d673ebd6-a916-4ae2-b4a2-b14d94aa9653 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:42.288645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d673ebd6-a916-4ae2-b4a2-b14d94aa9653 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:42.332082 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-d673ebd6-a916-4ae2-b4a2-b14d94aa9653 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916/ips" status: 200 len: 150 microversion: 2.20 time: 0.064246 May 12 11:46:42.345860 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 119/244] 10.222.0.58 () {60 vars in 1288 bytes} [Thu May 12 11:46:42 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916/ips => generated 150 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 11:46:42.992339 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-1eece4a9-2ed9-48d2-8701-75b9230da3a3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:42.992958 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-1eece4a9-2ed9-48d2-8701-75b9230da3a3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:42.999687 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-5f502fa5-58a6-4cf5-b2f4-da0fef74c866 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:43.000686 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-5f502fa5-58a6-4cf5-b2f4-da0fef74c866 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:43.005956 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1eece4a9-2ed9-48d2-8701-75b9230da3a3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:43.006666 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1eece4a9-2ed9-48d2-8701-75b9230da3a3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:43.007466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5f502fa5-58a6-4cf5-b2f4-da0fef74c866 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:43.007808 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1eece4a9-2ed9-48d2-8701-75b9230da3a3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:43.008061 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5f502fa5-58a6-4cf5-b2f4-da0fef74c866 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:43.008560 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1eece4a9-2ed9-48d2-8701-75b9230da3a3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:43.008970 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5f502fa5-58a6-4cf5-b2f4-da0fef74c866 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:43.009596 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5f502fa5-58a6-4cf5-b2f4-da0fef74c866 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:43.164921 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-1eece4a9-2ed9-48d2-8701-75b9230da3a3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:43.183228 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-1eece4a9-2ed9-48d2-8701-75b9230da3a3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1266 microversion: 2.1 time: 0.195413 May 12 11:46:43.213052 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 126/245] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:42 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:43.256894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-d583dd0b-28ab-48ed-bcfb-7125c22db0e8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:43.258099 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d583dd0b-28ab-48ed-bcfb-7125c22db0e8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:43.269084 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d583dd0b-28ab-48ed-bcfb-7125c22db0e8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:43.270550 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d583dd0b-28ab-48ed-bcfb-7125c22db0e8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:43.273152 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d583dd0b-28ab-48ed-bcfb-7125c22db0e8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:43.277028 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d583dd0b-28ab-48ed-bcfb-7125c22db0e8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:43.281681 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-5f502fa5-58a6-4cf5-b2f4-da0fef74c866 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:43.301642 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-5f502fa5-58a6-4cf5-b2f4-da0fef74c866 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.305261 May 12 11:46:43.317656 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 120/246] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:42 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:43.542387 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-d583dd0b-28ab-48ed-bcfb-7125c22db0e8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:43.562840 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-d583dd0b-28ab-48ed-bcfb-7125c22db0e8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.311412 May 12 11:46:43.569236 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 127/247] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:43 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:44.224228 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-25835015-80a9-4167-adb2-23a23333158c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:44.224847 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-25835015-80a9-4167-adb2-23a23333158c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:44.233857 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-25835015-80a9-4167-adb2-23a23333158c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:44.234394 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-25835015-80a9-4167-adb2-23a23333158c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:44.236360 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-25835015-80a9-4167-adb2-23a23333158c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:44.236832 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-25835015-80a9-4167-adb2-23a23333158c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:44.318133 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-25835015-80a9-4167-adb2-23a23333158c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:44.329681 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-25835015-80a9-4167-adb2-23a23333158c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1266 microversion: 2.1 time: 0.112473 May 12 11:46:44.331504 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-965d3e2f-c650-4b3e-b9e5-8039552d991b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:44.332213 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-965d3e2f-c650-4b3e-b9e5-8039552d991b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:44.332975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 121/248] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:44 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1266 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:44.344431 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-965d3e2f-c650-4b3e-b9e5-8039552d991b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:44.344947 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-965d3e2f-c650-4b3e-b9e5-8039552d991b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:44.345855 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-965d3e2f-c650-4b3e-b9e5-8039552d991b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:44.346288 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-965d3e2f-c650-4b3e-b9e5-8039552d991b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:44.501515 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-965d3e2f-c650-4b3e-b9e5-8039552d991b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:44.509157 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-965d3e2f-c650-4b3e-b9e5-8039552d991b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.188579 May 12 11:46:44.509898 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 128/249] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:44 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:44.585371 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-9ebaa3c5-dc8a-4940-9389-c9dfb32a0b8b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:44.586345 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-9ebaa3c5-dc8a-4940-9389-c9dfb32a0b8b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:44.597724 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9ebaa3c5-dc8a-4940-9389-c9dfb32a0b8b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:44.598180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9ebaa3c5-dc8a-4940-9389-c9dfb32a0b8b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:44.605206 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9ebaa3c5-dc8a-4940-9389-c9dfb32a0b8b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:44.605687 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9ebaa3c5-dc8a-4940-9389-c9dfb32a0b8b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:44.771082 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-9ebaa3c5-dc8a-4940-9389-c9dfb32a0b8b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:44.779206 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-9ebaa3c5-dc8a-4940-9389-c9dfb32a0b8b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.198477 May 12 11:46:44.779989 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 122/250] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:44 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:45.088592 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-7fe681d8-d683-4a8f-836c-97021fedfd27 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:46:45.089122 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-7fe681d8-d683-4a8f-836c-97021fedfd27 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:45.095135 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7fe681d8-d683-4a8f-836c-97021fedfd27 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:45.095582 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7fe681d8-d683-4a8f-836c-97021fedfd27 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:45.096339 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7fe681d8-d683-4a8f-836c-97021fedfd27 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:45.096769 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7fe681d8-d683-4a8f-836c-97021fedfd27 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:45.118074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.objects.instance [None req-7fe681d8-d683-4a8f-836c-97021fedfd27 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lazy-loading 'flavor' on Instance uuid c5cd2aad-2374-4ded-8b72-2e54fbbad916 {{(pid=123507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:46:45.348225 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-579481a7-3178-4fc9-8de8-96699cb0f1bb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:45.348843 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-579481a7-3178-4fc9-8de8-96699cb0f1bb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:45.355601 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-579481a7-3178-4fc9-8de8-96699cb0f1bb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:45.356049 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-579481a7-3178-4fc9-8de8-96699cb0f1bb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:45.356815 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-579481a7-3178-4fc9-8de8-96699cb0f1bb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:45.357253 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-579481a7-3178-4fc9-8de8-96699cb0f1bb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:45.423549 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-579481a7-3178-4fc9-8de8-96699cb0f1bb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:45.430939 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-579481a7-3178-4fc9-8de8-96699cb0f1bb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1266 microversion: 2.1 time: 0.086513 May 12 11:46:45.431504 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 123/251] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:45 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:45.527454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-186c3be6-984f-4279-8d97-2e0d033613e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:45.528072 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-186c3be6-984f-4279-8d97-2e0d033613e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:45.534191 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-186c3be6-984f-4279-8d97-2e0d033613e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:45.534653 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-186c3be6-984f-4279-8d97-2e0d033613e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:45.535430 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-186c3be6-984f-4279-8d97-2e0d033613e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:45.535871 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-186c3be6-984f-4279-8d97-2e0d033613e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:45.672661 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-186c3be6-984f-4279-8d97-2e0d033613e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:45.680510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-186c3be6-984f-4279-8d97-2e0d033613e7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.157113 May 12 11:46:45.681082 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 124/252] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:45 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:45.799483 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-387de43a-f4a4-46ce-88e0-618dfc44bd52 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:45.800489 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-387de43a-f4a4-46ce-88e0-618dfc44bd52 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:45.809797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-387de43a-f4a4-46ce-88e0-618dfc44bd52 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:45.810614 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-387de43a-f4a4-46ce-88e0-618dfc44bd52 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:45.811673 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-387de43a-f4a4-46ce-88e0-618dfc44bd52 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:45.812121 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-387de43a-f4a4-46ce-88e0-618dfc44bd52 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:45.949496 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-387de43a-f4a4-46ce-88e0-618dfc44bd52 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:45.957033 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-387de43a-f4a4-46ce-88e0-618dfc44bd52 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.161943 May 12 11:46:45.957596 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 125/253] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:45 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:46.450577 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-f5b1dc2c-d4f1-49eb-9038-58a9a9fea3b9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:46.451592 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-f5b1dc2c-d4f1-49eb-9038-58a9a9fea3b9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:46.459303 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f5b1dc2c-d4f1-49eb-9038-58a9a9fea3b9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:46.459738 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f5b1dc2c-d4f1-49eb-9038-58a9a9fea3b9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:46.460569 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f5b1dc2c-d4f1-49eb-9038-58a9a9fea3b9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:46.461002 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f5b1dc2c-d4f1-49eb-9038-58a9a9fea3b9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:46.534057 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-f5b1dc2c-d4f1-49eb-9038-58a9a9fea3b9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:46.542126 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-f5b1dc2c-d4f1-49eb-9038-58a9a9fea3b9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1266 microversion: 2.1 time: 0.097560 May 12 11:46:46.542981 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 126/254] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:46 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:46.697515 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-f53949af-dd4d-4ff0-9127-751df0daa368 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:46.698737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-f53949af-dd4d-4ff0-9127-751df0daa368 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:46.704971 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f53949af-dd4d-4ff0-9127-751df0daa368 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:46.705358 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f53949af-dd4d-4ff0-9127-751df0daa368 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:46.706150 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f53949af-dd4d-4ff0-9127-751df0daa368 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:46.706585 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f53949af-dd4d-4ff0-9127-751df0daa368 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:46.850663 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-f53949af-dd4d-4ff0-9127-751df0daa368 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:46.858991 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-f53949af-dd4d-4ff0-9127-751df0daa368 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.165218 May 12 11:46:46.859581 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 127/255] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:46 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:46.981840 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-08e1f872-5a36-46d9-abde-715dddb6cff8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:46.982586 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-08e1f872-5a36-46d9-abde-715dddb6cff8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:46.997363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-08e1f872-5a36-46d9-abde-715dddb6cff8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:46.998072 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-08e1f872-5a36-46d9-abde-715dddb6cff8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:46.998912 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-08e1f872-5a36-46d9-abde-715dddb6cff8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:46.999350 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-08e1f872-5a36-46d9-abde-715dddb6cff8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:47.152255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-08e1f872-5a36-46d9-abde-715dddb6cff8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:47.165876 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-08e1f872-5a36-46d9-abde-715dddb6cff8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.193151 May 12 11:46:47.166516 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 128/256] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:46 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:47.560763 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-db861a4a-b2e9-4233-b147-7defbc7600bb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:47.562233 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-db861a4a-b2e9-4233-b147-7defbc7600bb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:47.581607 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-db861a4a-b2e9-4233-b147-7defbc7600bb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:47.582175 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-db861a4a-b2e9-4233-b147-7defbc7600bb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:47.583180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-db861a4a-b2e9-4233-b147-7defbc7600bb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:47.583631 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-db861a4a-b2e9-4233-b147-7defbc7600bb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:47.679086 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-db861a4a-b2e9-4233-b147-7defbc7600bb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:47.687142 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-db861a4a-b2e9-4233-b147-7defbc7600bb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1266 microversion: 2.1 time: 0.131674 May 12 11:46:47.687713 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 129/257] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:47 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:47.879077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-729461e0-a753-451d-9001-7574052f6d15 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:47.881349 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-729461e0-a753-451d-9001-7574052f6d15 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:47.888555 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-729461e0-a753-451d-9001-7574052f6d15 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:47.889283 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-729461e0-a753-451d-9001-7574052f6d15 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:47.890257 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-729461e0-a753-451d-9001-7574052f6d15 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:47.890806 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-729461e0-a753-451d-9001-7574052f6d15 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:48.032344 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-729461e0-a753-451d-9001-7574052f6d15 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:48.039766 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-729461e0-a753-451d-9001-7574052f6d15 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.166934 May 12 11:46:48.040333 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 130/258] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:47 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:48.183748 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-6790487a-5b5d-4120-b68e-fd2b1562b0e4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:48.184284 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-6790487a-5b5d-4120-b68e-fd2b1562b0e4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:48.190603 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6790487a-5b5d-4120-b68e-fd2b1562b0e4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:48.191128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6790487a-5b5d-4120-b68e-fd2b1562b0e4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:48.191989 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6790487a-5b5d-4120-b68e-fd2b1562b0e4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:48.192506 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6790487a-5b5d-4120-b68e-fd2b1562b0e4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:48.352703 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-6790487a-5b5d-4120-b68e-fd2b1562b0e4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:48.368799 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-6790487a-5b5d-4120-b68e-fd2b1562b0e4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.188994 May 12 11:46:48.369765 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 131/259] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:48 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:48.705634 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-0c5b1075-d577-428f-a757-b311a6232427 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:48.706362 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-0c5b1075-d577-428f-a757-b311a6232427 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:48.712297 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0c5b1075-d577-428f-a757-b311a6232427 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:48.712966 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0c5b1075-d577-428f-a757-b311a6232427 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:48.713940 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0c5b1075-d577-428f-a757-b311a6232427 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:48.714526 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0c5b1075-d577-428f-a757-b311a6232427 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:48.779188 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-0c5b1075-d577-428f-a757-b311a6232427 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:48.787580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-0c5b1075-d577-428f-a757-b311a6232427 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1266 microversion: 2.1 time: 0.086393 May 12 11:46:48.788486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 132/260] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:48 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:49.056383 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-e1f2a7a3-a911-4492-a9c1-5d20a60442b2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:49.057040 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-e1f2a7a3-a911-4492-a9c1-5d20a60442b2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:49.068831 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e1f2a7a3-a911-4492-a9c1-5d20a60442b2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:49.069388 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e1f2a7a3-a911-4492-a9c1-5d20a60442b2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:49.070231 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e1f2a7a3-a911-4492-a9c1-5d20a60442b2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:49.070822 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e1f2a7a3-a911-4492-a9c1-5d20a60442b2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:49.263527 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-e1f2a7a3-a911-4492-a9c1-5d20a60442b2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:49.271590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-e1f2a7a3-a911-4492-a9c1-5d20a60442b2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.219124 May 12 11:46:49.272171 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 133/261] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:49 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:49.385988 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-977d9851-ea83-4069-9558-520c12f4cdc0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:49.386630 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-977d9851-ea83-4069-9558-520c12f4cdc0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:49.392794 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-977d9851-ea83-4069-9558-520c12f4cdc0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:49.393293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-977d9851-ea83-4069-9558-520c12f4cdc0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:49.394270 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-977d9851-ea83-4069-9558-520c12f4cdc0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:49.394536 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-977d9851-ea83-4069-9558-520c12f4cdc0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:49.576980 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-977d9851-ea83-4069-9558-520c12f4cdc0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:49.585257 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-977d9851-ea83-4069-9558-520c12f4cdc0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.203336 May 12 11:46:49.595212 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 134/262] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:49 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:49.804304 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-22cdc352-67bd-4271-8fab-a654170dc5f9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:49.805111 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-22cdc352-67bd-4271-8fab-a654170dc5f9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:49.815650 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-22cdc352-67bd-4271-8fab-a654170dc5f9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:49.816104 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-22cdc352-67bd-4271-8fab-a654170dc5f9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:49.816879 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-22cdc352-67bd-4271-8fab-a654170dc5f9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:49.817464 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-22cdc352-67bd-4271-8fab-a654170dc5f9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:49.882558 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-22cdc352-67bd-4271-8fab-a654170dc5f9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:49.889633 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-22cdc352-67bd-4271-8fab-a654170dc5f9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1266 microversion: 2.1 time: 0.089175 May 12 11:46:49.890234 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 135/263] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:49 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:50.299716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-c26e6461-a5e5-4182-9164-3d8564bc636d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:50.300401 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-c26e6461-a5e5-4182-9164-3d8564bc636d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:50.312806 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c26e6461-a5e5-4182-9164-3d8564bc636d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:50.313370 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c26e6461-a5e5-4182-9164-3d8564bc636d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:50.314256 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c26e6461-a5e5-4182-9164-3d8564bc636d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:50.314766 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c26e6461-a5e5-4182-9164-3d8564bc636d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:50.511420 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c26e6461-a5e5-4182-9164-3d8564bc636d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:50.518957 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-c26e6461-a5e5-4182-9164-3d8564bc636d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.232553 May 12 11:46:50.519535 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 136/264] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:50 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:50.602419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-84d41436-a66e-42d1-a115-01c3f4d7bfe8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:50.603024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-84d41436-a66e-42d1-a115-01c3f4d7bfe8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:50.608747 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-84d41436-a66e-42d1-a115-01c3f4d7bfe8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:50.609194 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-84d41436-a66e-42d1-a115-01c3f4d7bfe8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:50.609987 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-84d41436-a66e-42d1-a115-01c3f4d7bfe8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:50.610425 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-84d41436-a66e-42d1-a115-01c3f4d7bfe8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:50.768318 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-84d41436-a66e-42d1-a115-01c3f4d7bfe8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:50.777074 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-84d41436-a66e-42d1-a115-01c3f4d7bfe8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.178470 May 12 11:46:50.777817 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 137/265] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:50 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:50.907351 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-155d0e96-0018-4062-82d2-7f74f18c1542 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:50.907973 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-155d0e96-0018-4062-82d2-7f74f18c1542 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:50.914471 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-155d0e96-0018-4062-82d2-7f74f18c1542 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:50.914928 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-155d0e96-0018-4062-82d2-7f74f18c1542 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:50.915709 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-155d0e96-0018-4062-82d2-7f74f18c1542 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:50.916147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-155d0e96-0018-4062-82d2-7f74f18c1542 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:51.005761 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-155d0e96-0018-4062-82d2-7f74f18c1542 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:51.013590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-155d0e96-0018-4062-82d2-7f74f18c1542 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1266 microversion: 2.1 time: 0.110515 May 12 11:46:51.014182 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 138/266] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:50 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:51.536541 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a037ab4e-9e5c-49cf-86af-f63a10e5520b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:51.537148 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-a037ab4e-9e5c-49cf-86af-f63a10e5520b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:51.543782 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a037ab4e-9e5c-49cf-86af-f63a10e5520b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:51.544242 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a037ab4e-9e5c-49cf-86af-f63a10e5520b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:51.545012 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a037ab4e-9e5c-49cf-86af-f63a10e5520b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:51.545454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a037ab4e-9e5c-49cf-86af-f63a10e5520b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:51.683288 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-a037ab4e-9e5c-49cf-86af-f63a10e5520b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:51.690866 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-a037ab4e-9e5c-49cf-86af-f63a10e5520b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.158122 May 12 11:46:51.691439 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 139/267] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:51 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:51.794843 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-d259e736-ffdb-4847-bab4-91e8abbb2c1b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:51.795363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d259e736-ffdb-4847-bab4-91e8abbb2c1b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:51.802123 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d259e736-ffdb-4847-bab4-91e8abbb2c1b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:51.802630 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d259e736-ffdb-4847-bab4-91e8abbb2c1b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:51.803500 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d259e736-ffdb-4847-bab4-91e8abbb2c1b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:51.804029 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d259e736-ffdb-4847-bab4-91e8abbb2c1b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:51.970604 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-d259e736-ffdb-4847-bab4-91e8abbb2c1b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:51.981108 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-d259e736-ffdb-4847-bab4-91e8abbb2c1b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.190691 May 12 11:46:51.982097 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 140/268] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:51 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:52.031192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-e2204483-6c71-424b-9397-509ee2aafe31 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:52.031847 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-e2204483-6c71-424b-9397-509ee2aafe31 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:52.059752 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e2204483-6c71-424b-9397-509ee2aafe31 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:52.059752 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e2204483-6c71-424b-9397-509ee2aafe31 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:52.060392 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e2204483-6c71-424b-9397-509ee2aafe31 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:52.067311 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e2204483-6c71-424b-9397-509ee2aafe31 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:52.195779 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-e2204483-6c71-424b-9397-509ee2aafe31 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:52.204508 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-e2204483-6c71-424b-9397-509ee2aafe31 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1266 microversion: 2.1 time: 0.178268 May 12 11:46:52.219227 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 141/269] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:52 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:52.708636 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-be7b3cdb-30ec-494d-bb6a-5f9db4cd3bd5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:52.710402 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-be7b3cdb-30ec-494d-bb6a-5f9db4cd3bd5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:52.718135 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-be7b3cdb-30ec-494d-bb6a-5f9db4cd3bd5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:52.718850 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-be7b3cdb-30ec-494d-bb6a-5f9db4cd3bd5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:52.719649 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-be7b3cdb-30ec-494d-bb6a-5f9db4cd3bd5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:52.720088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-be7b3cdb-30ec-494d-bb6a-5f9db4cd3bd5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:52.856549 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-be7b3cdb-30ec-494d-bb6a-5f9db4cd3bd5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:52.864426 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-be7b3cdb-30ec-494d-bb6a-5f9db4cd3bd5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.159634 May 12 11:46:52.865011 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 142/270] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:52 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:52.998993 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-9ad88e98-d2a0-4181-b86b-e746b3f3a810 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:52.999593 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-9ad88e98-d2a0-4181-b86b-e746b3f3a810 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:53.005961 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9ad88e98-d2a0-4181-b86b-e746b3f3a810 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:53.006251 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9ad88e98-d2a0-4181-b86b-e746b3f3a810 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:53.007110 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9ad88e98-d2a0-4181-b86b-e746b3f3a810 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:53.007545 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9ad88e98-d2a0-4181-b86b-e746b3f3a810 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:53.138262 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-9ad88e98-d2a0-4181-b86b-e746b3f3a810 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:53.145923 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-9ad88e98-d2a0-4181-b86b-e746b3f3a810 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.151147 May 12 11:46:53.146511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 143/271] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:52 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:53.226295 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-edc54460-97c6-4b5a-aa18-a61e5495f594 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:53.227018 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-edc54460-97c6-4b5a-aa18-a61e5495f594 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:53.233335 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-edc54460-97c6-4b5a-aa18-a61e5495f594 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:53.233954 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-edc54460-97c6-4b5a-aa18-a61e5495f594 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:53.234799 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-edc54460-97c6-4b5a-aa18-a61e5495f594 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:53.235265 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-edc54460-97c6-4b5a-aa18-a61e5495f594 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:53.302877 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-edc54460-97c6-4b5a-aa18-a61e5495f594 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:53.310719 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-edc54460-97c6-4b5a-aa18-a61e5495f594 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1266 microversion: 2.1 time: 0.088233 May 12 11:46:53.311335 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 144/272] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:53 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:53.311980 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-7fe681d8-d683-4a8f-836c-97021fedfd27 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "POST /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916/action" status: 202 len: 0 microversion: 2.20 time: 8.227195 May 12 11:46:53.312598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 129/273] 10.222.0.58 () {62 vars in 1318 bytes} [Thu May 12 11:46:45 2022] POST /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916/action => generated 0 bytes in 8229 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 11:46:53.320731 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-1f942afa-24ee-4ed7-9a8c-21a03154c44b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:53.321425 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-1f942afa-24ee-4ed7-9a8c-21a03154c44b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:53.329768 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1f942afa-24ee-4ed7-9a8c-21a03154c44b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:53.330368 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1f942afa-24ee-4ed7-9a8c-21a03154c44b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:53.331334 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1f942afa-24ee-4ed7-9a8c-21a03154c44b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:53.331780 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1f942afa-24ee-4ed7-9a8c-21a03154c44b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:53.456992 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-1f942afa-24ee-4ed7-9a8c-21a03154c44b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:53.464948 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-1f942afa-24ee-4ed7-9a8c-21a03154c44b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:53.466471 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-1f942afa-24ee-4ed7-9a8c-21a03154c44b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:53.467615 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-1f942afa-24ee-4ed7-9a8c-21a03154c44b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.150844 May 12 11:46:53.468174 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 145/274] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:46:53 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:46:53.881335 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-c6cafe18-b4b4-4cf0-bebb-d5e4501cdc9d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:53.882062 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-c6cafe18-b4b4-4cf0-bebb-d5e4501cdc9d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:53.888811 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c6cafe18-b4b4-4cf0-bebb-d5e4501cdc9d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:53.889262 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c6cafe18-b4b4-4cf0-bebb-d5e4501cdc9d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:53.890053 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c6cafe18-b4b4-4cf0-bebb-d5e4501cdc9d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:53.890496 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c6cafe18-b4b4-4cf0-bebb-d5e4501cdc9d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:54.024489 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-c6cafe18-b4b4-4cf0-bebb-d5e4501cdc9d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:54.032433 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-c6cafe18-b4b4-4cf0-bebb-d5e4501cdc9d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.155724 May 12 11:46:54.033006 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 130/275] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:53 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:54.162356 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-132da170-26a4-46de-9877-0a5c684086f2 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:54.162867 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-132da170-26a4-46de-9877-0a5c684086f2 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:54.169418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-132da170-26a4-46de-9877-0a5c684086f2 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:54.169896 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-132da170-26a4-46de-9877-0a5c684086f2 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:54.170659 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-132da170-26a4-46de-9877-0a5c684086f2 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:54.171093 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-132da170-26a4-46de-9877-0a5c684086f2 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:54.302767 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-132da170-26a4-46de-9877-0a5c684086f2 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:54.310160 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-132da170-26a4-46de-9877-0a5c684086f2 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.151681 May 12 11:46:54.310721 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 146/276] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:54 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:54.328076 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-377209e7-05a3-4576-92cc-cf06d3fcb557 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:54.328713 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-377209e7-05a3-4576-92cc-cf06d3fcb557 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:54.334766 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-377209e7-05a3-4576-92cc-cf06d3fcb557 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:54.335224 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-377209e7-05a3-4576-92cc-cf06d3fcb557 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:54.336016 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-377209e7-05a3-4576-92cc-cf06d3fcb557 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:54.336452 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-377209e7-05a3-4576-92cc-cf06d3fcb557 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:54.397145 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-377209e7-05a3-4576-92cc-cf06d3fcb557 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:54.405341 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-377209e7-05a3-4576-92cc-cf06d3fcb557 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1266 microversion: 2.1 time: 0.081256 May 12 11:46:54.405955 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 131/277] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:54 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:54.485980 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-aa1d783c-55b0-4f19-88f1-c710cda1ea40 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:54.486723 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-aa1d783c-55b0-4f19-88f1-c710cda1ea40 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:54.493517 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-aa1d783c-55b0-4f19-88f1-c710cda1ea40 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:54.494000 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-aa1d783c-55b0-4f19-88f1-c710cda1ea40 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:54.494936 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-aa1d783c-55b0-4f19-88f1-c710cda1ea40 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:54.495369 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-aa1d783c-55b0-4f19-88f1-c710cda1ea40 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:54.834502 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-aa1d783c-55b0-4f19-88f1-c710cda1ea40 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:54.842324 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-aa1d783c-55b0-4f19-88f1-c710cda1ea40 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:54.843836 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-aa1d783c-55b0-4f19-88f1-c710cda1ea40 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:54.844992 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-aa1d783c-55b0-4f19-88f1-c710cda1ea40 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.362996 May 12 11:46:54.845550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 147/278] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:46:54 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:46:55.050168 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-aabd864f-5edd-44cd-a680-780f569a6b45 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:55.050694 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-aabd864f-5edd-44cd-a680-780f569a6b45 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:55.058058 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-aabd864f-5edd-44cd-a680-780f569a6b45 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:55.058508 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-aabd864f-5edd-44cd-a680-780f569a6b45 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:55.059290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-aabd864f-5edd-44cd-a680-780f569a6b45 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:55.059733 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-aabd864f-5edd-44cd-a680-780f569a6b45 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:55.191828 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-aabd864f-5edd-44cd-a680-780f569a6b45 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:55.199204 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-aabd864f-5edd-44cd-a680-780f569a6b45 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.152948 May 12 11:46:55.199769 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 132/279] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:55 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:55.327544 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-5f8d82cb-7ab0-4b5b-acc7-aff7df1025b7 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:55.328072 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-5f8d82cb-7ab0-4b5b-acc7-aff7df1025b7 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:55.333968 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5f8d82cb-7ab0-4b5b-acc7-aff7df1025b7 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:55.334442 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5f8d82cb-7ab0-4b5b-acc7-aff7df1025b7 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:55.335201 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5f8d82cb-7ab0-4b5b-acc7-aff7df1025b7 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:55.335641 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5f8d82cb-7ab0-4b5b-acc7-aff7df1025b7 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:55.422428 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-425eca60-08e9-4dfb-97c1-43c45ee1a6d2 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:55.423037 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-425eca60-08e9-4dfb-97c1-43c45ee1a6d2 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:55.428818 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-425eca60-08e9-4dfb-97c1-43c45ee1a6d2 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:55.429268 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-425eca60-08e9-4dfb-97c1-43c45ee1a6d2 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:55.430059 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-425eca60-08e9-4dfb-97c1-43c45ee1a6d2 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:55.430495 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-425eca60-08e9-4dfb-97c1-43c45ee1a6d2 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:55.462329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-5f8d82cb-7ab0-4b5b-acc7-aff7df1025b7 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:55.472236 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-5f8d82cb-7ab0-4b5b-acc7-aff7df1025b7 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.148106 May 12 11:46:55.472236 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 148/280] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:55 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:55.497882 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-425eca60-08e9-4dfb-97c1-43c45ee1a6d2 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:55.505201 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-425eca60-08e9-4dfb-97c1-43c45ee1a6d2 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1266 microversion: 2.1 time: 0.086524 May 12 11:46:55.505784 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 133/281] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:55 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:55.863801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-908acf79-9dae-4bad-bbb4-3673f118ee6e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:55.864509 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-908acf79-9dae-4bad-bbb4-3673f118ee6e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:55.871176 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-908acf79-9dae-4bad-bbb4-3673f118ee6e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:55.871623 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-908acf79-9dae-4bad-bbb4-3673f118ee6e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:55.872404 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-908acf79-9dae-4bad-bbb4-3673f118ee6e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:55.872841 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-908acf79-9dae-4bad-bbb4-3673f118ee6e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:56.009064 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-908acf79-9dae-4bad-bbb4-3673f118ee6e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:56.018806 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-908acf79-9dae-4bad-bbb4-3673f118ee6e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:56.020636 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-908acf79-9dae-4bad-bbb4-3673f118ee6e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:56.021820 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-908acf79-9dae-4bad-bbb4-3673f118ee6e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.162509 May 12 11:46:56.022686 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 149/282] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:46:55 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:46:56.218127 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-9843053d-b23a-4d17-b080-4187ac386fb8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:56.218719 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-9843053d-b23a-4d17-b080-4187ac386fb8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:56.225454 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9843053d-b23a-4d17-b080-4187ac386fb8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:56.225937 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9843053d-b23a-4d17-b080-4187ac386fb8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:56.226732 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9843053d-b23a-4d17-b080-4187ac386fb8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:56.227663 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9843053d-b23a-4d17-b080-4187ac386fb8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:56.503783 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-607abb73-01fa-4739-b06a-dc4d32c2dc39 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:56.504687 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-607abb73-01fa-4739-b06a-dc4d32c2dc39 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:56.519509 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-607abb73-01fa-4739-b06a-dc4d32c2dc39 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:56.522518 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-607abb73-01fa-4739-b06a-dc4d32c2dc39 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:56.525155 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-607abb73-01fa-4739-b06a-dc4d32c2dc39 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:56.528071 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-607abb73-01fa-4739-b06a-dc4d32c2dc39 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:56.671742 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-9843053d-b23a-4d17-b080-4187ac386fb8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:56.696676 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-9843053d-b23a-4d17-b080-4187ac386fb8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.483002 May 12 11:46:56.697499 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 134/283] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:56 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:56.715210 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-d763bb6f-1da1-45be-92d8-4496e7e8c1cb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:56.717162 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d763bb6f-1da1-45be-92d8-4496e7e8c1cb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:56.725885 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d763bb6f-1da1-45be-92d8-4496e7e8c1cb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:56.726710 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d763bb6f-1da1-45be-92d8-4496e7e8c1cb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:56.729573 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d763bb6f-1da1-45be-92d8-4496e7e8c1cb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:56.730264 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d763bb6f-1da1-45be-92d8-4496e7e8c1cb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:56.816774 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-607abb73-01fa-4739-b06a-dc4d32c2dc39 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:56.828450 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-607abb73-01fa-4739-b06a-dc4d32c2dc39 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.339961 May 12 11:46:56.829647 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 150/284] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:56 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:56.841637 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-d763bb6f-1da1-45be-92d8-4496e7e8c1cb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:56.849639 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-d763bb6f-1da1-45be-92d8-4496e7e8c1cb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1272 microversion: 2.1 time: 0.147174 May 12 11:46:56.850449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 135/285] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:56 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:57.041139 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-4e2a6a76-bb56-488c-b665-276d96f16a1f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:57.042497 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-4e2a6a76-bb56-488c-b665-276d96f16a1f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:57.049925 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4e2a6a76-bb56-488c-b665-276d96f16a1f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:57.050432 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4e2a6a76-bb56-488c-b665-276d96f16a1f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:57.051385 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4e2a6a76-bb56-488c-b665-276d96f16a1f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:57.051835 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4e2a6a76-bb56-488c-b665-276d96f16a1f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:57.253408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-6fd03f83-fca1-48b1-8193-6b2b589b8a2f req-e74fd8d3-3ede-4c67-87fc-ed99e8c6209e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a03ef4f-9cf8-4749-8eb8-9077d5987909", "tag": "5467d5f0-8b8e-4bbd-967c-8638230e171e"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:46:57.262566 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-4e2a6a76-bb56-488c-b665-276d96f16a1f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:57.277779 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-6fd03f83-fca1-48b1-8193-6b2b589b8a2f req-e74fd8d3-3ede-4c67-87fc-ed99e8c6209e service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:57.281763 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-4e2a6a76-bb56-488c-b665-276d96f16a1f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:57.282432 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-6fd03f83-fca1-48b1-8193-6b2b589b8a2f req-e74fd8d3-3ede-4c67-87fc-ed99e8c6209e service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:57.292077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-4e2a6a76-bb56-488c-b665-276d96f16a1f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:57.293752 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-4e2a6a76-bb56-488c-b665-276d96f16a1f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.257179 May 12 11:46:57.295877 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 151/286] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:46:57 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:46:57.298307 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-6fd03f83-fca1-48b1-8193-6b2b589b8a2f req-e74fd8d3-3ede-4c67-87fc-ed99e8c6209e service nova] Creating event network-changed:5467d5f0-8b8e-4bbd-967c-8638230e171e for instance 3a03ef4f-9cf8-4749-8eb8-9077d5987909 on hv-cinder-80473 May 12 11:46:57.304940 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-6fd03f83-fca1-48b1-8193-6b2b589b8a2f req-e74fd8d3-3ede-4c67-87fc-ed99e8c6209e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056119 May 12 11:46:57.305752 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 136/287] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:46:57.713944 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-e94816af-acca-46d5-a353-ffb7655337bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:57.714501 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-e94816af-acca-46d5-a353-ffb7655337bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:57.720397 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e94816af-acca-46d5-a353-ffb7655337bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:57.720859 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e94816af-acca-46d5-a353-ffb7655337bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:57.721626 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e94816af-acca-46d5-a353-ffb7655337bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:57.722094 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e94816af-acca-46d5-a353-ffb7655337bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:57.847878 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-6e332cae-8455-430f-88c3-7289dbe7bfe8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:57.848762 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-6e332cae-8455-430f-88c3-7289dbe7bfe8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:57.853177 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-e94816af-acca-46d5-a353-ffb7655337bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:57.855522 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6e332cae-8455-430f-88c3-7289dbe7bfe8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:57.855968 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6e332cae-8455-430f-88c3-7289dbe7bfe8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:57.856736 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6e332cae-8455-430f-88c3-7289dbe7bfe8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:57.857166 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6e332cae-8455-430f-88c3-7289dbe7bfe8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:57.862555 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-e94816af-acca-46d5-a353-ffb7655337bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.152577 May 12 11:46:57.863145 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 152/288] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:57 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:57.867588 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-8f690e45-be11-4f56-a8ba-962c708bc2d3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:57.868193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-8f690e45-be11-4f56-a8ba-962c708bc2d3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:57.874614 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8f690e45-be11-4f56-a8ba-962c708bc2d3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:57.875050 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8f690e45-be11-4f56-a8ba-962c708bc2d3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:57.875827 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8f690e45-be11-4f56-a8ba-962c708bc2d3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:57.876281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8f690e45-be11-4f56-a8ba-962c708bc2d3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:57.984942 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-6e332cae-8455-430f-88c3-7289dbe7bfe8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:57.993499 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-6e332cae-8455-430f-88c3-7289dbe7bfe8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.151165 May 12 11:46:57.994632 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 137/289] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:57 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:58.006991 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8f690e45-be11-4f56-a8ba-962c708bc2d3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:58.014790 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-8f690e45-be11-4f56-a8ba-962c708bc2d3 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1314 microversion: 2.1 time: 0.150684 May 12 11:46:58.015349 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 153/290] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:57 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:58.312624 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-452d0d8b-98bb-45e5-8181-5482c9edb018 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:58.313232 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-452d0d8b-98bb-45e5-8181-5482c9edb018 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:58.319675 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-452d0d8b-98bb-45e5-8181-5482c9edb018 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:58.320124 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-452d0d8b-98bb-45e5-8181-5482c9edb018 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:58.320886 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-452d0d8b-98bb-45e5-8181-5482c9edb018 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:58.321320 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-452d0d8b-98bb-45e5-8181-5482c9edb018 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:58.453466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-452d0d8b-98bb-45e5-8181-5482c9edb018 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:58.461253 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-452d0d8b-98bb-45e5-8181-5482c9edb018 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:58.462766 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-452d0d8b-98bb-45e5-8181-5482c9edb018 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:58.463961 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-452d0d8b-98bb-45e5-8181-5482c9edb018 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.155242 May 12 11:46:58.464508 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 138/291] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:46:58 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:46:58.879937 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-28a72195-b1d2-4ce2-8a1f-20c6e65b593b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:58.880539 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-28a72195-b1d2-4ce2-8a1f-20c6e65b593b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:58.886962 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-28a72195-b1d2-4ce2-8a1f-20c6e65b593b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:58.887408 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-28a72195-b1d2-4ce2-8a1f-20c6e65b593b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:58.888159 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-28a72195-b1d2-4ce2-8a1f-20c6e65b593b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:58.888586 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-28a72195-b1d2-4ce2-8a1f-20c6e65b593b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:59.010710 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-7f69b88c-b640-4c06-8b67-9850d1a3d813 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:59.011471 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-7f69b88c-b640-4c06-8b67-9850d1a3d813 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:59.014024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-28a72195-b1d2-4ce2-8a1f-20c6e65b593b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:59.017433 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7f69b88c-b640-4c06-8b67-9850d1a3d813 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:59.017925 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7f69b88c-b640-4c06-8b67-9850d1a3d813 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:59.018706 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7f69b88c-b640-4c06-8b67-9850d1a3d813 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:59.019143 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7f69b88c-b640-4c06-8b67-9850d1a3d813 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:59.021139 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-28a72195-b1d2-4ce2-8a1f-20c6e65b593b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.145036 May 12 11:46:59.021724 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 154/292] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:58 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:46:59.030707 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-f2dc8119-2512-4bf0-bbdf-b52f3149166c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:59.031308 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-f2dc8119-2512-4bf0-bbdf-b52f3149166c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:59.036930 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f2dc8119-2512-4bf0-bbdf-b52f3149166c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:59.037368 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f2dc8119-2512-4bf0-bbdf-b52f3149166c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:59.038145 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f2dc8119-2512-4bf0-bbdf-b52f3149166c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:59.038574 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f2dc8119-2512-4bf0-bbdf-b52f3149166c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:59.151023 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-7f69b88c-b640-4c06-8b67-9850d1a3d813 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:59.158328 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-7f69b88c-b640-4c06-8b67-9850d1a3d813 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.151455 May 12 11:46:59.158913 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 139/293] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:59 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:59.171020 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-f2dc8119-2512-4bf0-bbdf-b52f3149166c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:59.178314 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-f2dc8119-2512-4bf0-bbdf-b52f3149166c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1314 microversion: 2.1 time: 0.151181 May 12 11:46:59.178874 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 155/294] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:46:59 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:46:59.480842 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-4b151333-31e1-4934-8d52-b89b19488e78 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:46:59.481444 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-4b151333-31e1-4934-8d52-b89b19488e78 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:46:59.487736 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4b151333-31e1-4934-8d52-b89b19488e78 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:59.488186 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4b151333-31e1-4934-8d52-b89b19488e78 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:59.489007 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4b151333-31e1-4934-8d52-b89b19488e78 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:46:59.489372 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4b151333-31e1-4934-8d52-b89b19488e78 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:46:59.621108 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-4b151333-31e1-4934-8d52-b89b19488e78 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:59.628777 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-4b151333-31e1-4934-8d52-b89b19488e78 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:59.630364 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-4b151333-31e1-4934-8d52-b89b19488e78 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:46:59.631517 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-4b151333-31e1-4934-8d52-b89b19488e78 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.154502 May 12 11:46:59.632134 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 140/295] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:46:59 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:00.037785 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-777ebf5a-1c40-4435-94b0-e0882dca4927 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:00.038427 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-777ebf5a-1c40-4435-94b0-e0882dca4927 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:00.044792 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-777ebf5a-1c40-4435-94b0-e0882dca4927 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:00.045247 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-777ebf5a-1c40-4435-94b0-e0882dca4927 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:00.046048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-777ebf5a-1c40-4435-94b0-e0882dca4927 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:00.046491 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-777ebf5a-1c40-4435-94b0-e0882dca4927 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:00.174462 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-ae12985e-6c80-4260-9427-de5b4b62aec1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:00.175073 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-ae12985e-6c80-4260-9427-de5b4b62aec1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:00.181158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ae12985e-6c80-4260-9427-de5b4b62aec1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:00.181607 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ae12985e-6c80-4260-9427-de5b4b62aec1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:00.182426 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ae12985e-6c80-4260-9427-de5b4b62aec1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:00.182863 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ae12985e-6c80-4260-9427-de5b4b62aec1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:00.275469 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-777ebf5a-1c40-4435-94b0-e0882dca4927 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:00.284555 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-777ebf5a-1c40-4435-94b0-e0882dca4927 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.250615 May 12 11:47:00.285298 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 156/296] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:00 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:00.290989 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-507978be-05e8-413b-be0c-3b3482aed1f6 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:00.291787 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-507978be-05e8-413b-be0c-3b3482aed1f6 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:00.298383 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-507978be-05e8-413b-be0c-3b3482aed1f6 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:00.298823 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-507978be-05e8-413b-be0c-3b3482aed1f6 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:00.299643 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-507978be-05e8-413b-be0c-3b3482aed1f6 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:00.300083 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-507978be-05e8-413b-be0c-3b3482aed1f6 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:00.347549 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-ae12985e-6c80-4260-9427-de5b4b62aec1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:00.355032 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-ae12985e-6c80-4260-9427-de5b4b62aec1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.184183 May 12 11:47:00.355737 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 141/297] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:00 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:00.493263 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-507978be-05e8-413b-be0c-3b3482aed1f6 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:00.501117 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-507978be-05e8-413b-be0c-3b3482aed1f6 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1314 microversion: 2.1 time: 0.214615 May 12 11:47:00.506133 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-840c9e62-be55-4de1-a9b2-02df17beb377 req-d061b48f-88cf-4c74-ab49-3b37c4f34329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea", "tag": "82b8454d-541b-4f2e-8c06-d39a1129aabb"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:47:00.509661 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 157/298] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:00 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:00.516430 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-840c9e62-be55-4de1-a9b2-02df17beb377 req-d061b48f-88cf-4c74-ab49-3b37c4f34329 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:00.517057 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-840c9e62-be55-4de1-a9b2-02df17beb377 req-d061b48f-88cf-4c74-ab49-3b37c4f34329 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:00.528677 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-840c9e62-be55-4de1-a9b2-02df17beb377 req-d061b48f-88cf-4c74-ab49-3b37c4f34329 service nova] Creating event network-changed:82b8454d-541b-4f2e-8c06-d39a1129aabb for instance 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea on hv-cinder-80473 May 12 11:47:00.533471 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-840c9e62-be55-4de1-a9b2-02df17beb377 req-d061b48f-88cf-4c74-ab49-3b37c4f34329 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030840 May 12 11:47:00.534448 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 142/299] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:47:00.650210 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-989abb25-e259-4769-af7f-af2f92d6ff0c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:00.650908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-989abb25-e259-4769-af7f-af2f92d6ff0c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:00.656626 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-989abb25-e259-4769-af7f-af2f92d6ff0c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:00.657068 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-989abb25-e259-4769-af7f-af2f92d6ff0c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:00.657856 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-989abb25-e259-4769-af7f-af2f92d6ff0c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:00.658291 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-989abb25-e259-4769-af7f-af2f92d6ff0c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:00.796698 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-989abb25-e259-4769-af7f-af2f92d6ff0c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:00.806115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-989abb25-e259-4769-af7f-af2f92d6ff0c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:00.808194 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-989abb25-e259-4769-af7f-af2f92d6ff0c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:00.809402 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-989abb25-e259-4769-af7f-af2f92d6ff0c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.163068 May 12 11:47:00.810006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 158/300] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:00 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:01.302304 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-cf0dff1f-177f-42bb-8b8b-f246c7b51433 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:01.303001 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-cf0dff1f-177f-42bb-8b8b-f246c7b51433 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:01.310349 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cf0dff1f-177f-42bb-8b8b-f246c7b51433 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:01.310804 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cf0dff1f-177f-42bb-8b8b-f246c7b51433 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:01.311566 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cf0dff1f-177f-42bb-8b8b-f246c7b51433 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:01.312004 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cf0dff1f-177f-42bb-8b8b-f246c7b51433 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:01.373051 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-8e231e58-180e-4cf1-bd5a-033678ce797f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:01.373676 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-8e231e58-180e-4cf1-bd5a-033678ce797f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:01.379693 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8e231e58-180e-4cf1-bd5a-033678ce797f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:01.380149 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8e231e58-180e-4cf1-bd5a-033678ce797f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:01.380923 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8e231e58-180e-4cf1-bd5a-033678ce797f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:01.381366 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8e231e58-180e-4cf1-bd5a-033678ce797f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:01.441956 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-cf0dff1f-177f-42bb-8b8b-f246c7b51433 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:01.449316 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-cf0dff1f-177f-42bb-8b8b-f246c7b51433 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.151384 May 12 11:47:01.450116 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 143/301] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:01 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:01.509766 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8e231e58-180e-4cf1-bd5a-033678ce797f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:01.516986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-8e231e58-180e-4cf1-bd5a-033678ce797f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.148634 May 12 11:47:01.517688 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 159/302] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:01 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:01.518760 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-121a639c-361f-4ad3-8d68-a0dca15ba4fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:01.519377 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-121a639c-361f-4ad3-8d68-a0dca15ba4fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:01.526425 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-121a639c-361f-4ad3-8d68-a0dca15ba4fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:01.526894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-121a639c-361f-4ad3-8d68-a0dca15ba4fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:01.527646 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-121a639c-361f-4ad3-8d68-a0dca15ba4fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:01.528082 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-121a639c-361f-4ad3-8d68-a0dca15ba4fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:01.659131 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-121a639c-361f-4ad3-8d68-a0dca15ba4fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:01.667022 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-121a639c-361f-4ad3-8d68-a0dca15ba4fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1314 microversion: 2.1 time: 0.151676 May 12 11:47:01.667588 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 144/303] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:01 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:01.827609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-fed278e1-45b4-447c-bf6c-3f4c75e4d49a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:01.828208 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-fed278e1-45b4-447c-bf6c-3f4c75e4d49a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:01.834029 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fed278e1-45b4-447c-bf6c-3f4c75e4d49a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:01.834468 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fed278e1-45b4-447c-bf6c-3f4c75e4d49a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:01.835220 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fed278e1-45b4-447c-bf6c-3f4c75e4d49a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:01.835646 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fed278e1-45b4-447c-bf6c-3f4c75e4d49a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:01.963073 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-fed278e1-45b4-447c-bf6c-3f4c75e4d49a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:01.970743 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-fed278e1-45b4-447c-bf6c-3f4c75e4d49a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:01.972257 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-fed278e1-45b4-447c-bf6c-3f4c75e4d49a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:01.973407 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-fed278e1-45b4-447c-bf6c-3f4c75e4d49a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.149907 May 12 11:47:01.974003 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 160/304] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:01 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:02.467181 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-e6556c45-c2c3-4724-9fc7-b7f84104bb26 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:02.467785 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-e6556c45-c2c3-4724-9fc7-b7f84104bb26 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:02.480170 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e6556c45-c2c3-4724-9fc7-b7f84104bb26 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:02.481081 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e6556c45-c2c3-4724-9fc7-b7f84104bb26 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:02.481804 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e6556c45-c2c3-4724-9fc7-b7f84104bb26 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:02.482247 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e6556c45-c2c3-4724-9fc7-b7f84104bb26 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:02.533124 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-5dfa0909-39e4-433d-a667-c80e63b27436 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:02.533755 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-5dfa0909-39e4-433d-a667-c80e63b27436 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:02.539725 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5dfa0909-39e4-433d-a667-c80e63b27436 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:02.540252 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5dfa0909-39e4-433d-a667-c80e63b27436 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:02.541153 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5dfa0909-39e4-433d-a667-c80e63b27436 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:02.541660 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5dfa0909-39e4-433d-a667-c80e63b27436 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:02.613557 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-e6556c45-c2c3-4724-9fc7-b7f84104bb26 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:02.621830 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-e6556c45-c2c3-4724-9fc7-b7f84104bb26 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.158910 May 12 11:47:02.622645 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 145/305] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:02 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:02.670988 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-5dfa0909-39e4-433d-a667-c80e63b27436 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:02.678556 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-5dfa0909-39e4-433d-a667-c80e63b27436 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.148829 May 12 11:47:02.679204 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 161/306] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:02 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:02.683500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-5ee294fd-7167-479f-a3bd-62a409d11834 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:02.684134 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-5ee294fd-7167-479f-a3bd-62a409d11834 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:02.689980 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5ee294fd-7167-479f-a3bd-62a409d11834 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:02.690426 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5ee294fd-7167-479f-a3bd-62a409d11834 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:02.691196 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5ee294fd-7167-479f-a3bd-62a409d11834 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:02.691625 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5ee294fd-7167-479f-a3bd-62a409d11834 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:02.819019 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-5ee294fd-7167-479f-a3bd-62a409d11834 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:02.827043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-5ee294fd-7167-479f-a3bd-62a409d11834 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1314 microversion: 2.1 time: 0.147419 May 12 11:47:02.827603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 146/307] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:02 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:02.992081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-6cea8bae-d0c7-47b1-8f41-4460d4bc1da8 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:02.992712 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-6cea8bae-d0c7-47b1-8f41-4460d4bc1da8 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:02.999275 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6cea8bae-d0c7-47b1-8f41-4460d4bc1da8 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:02.999751 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6cea8bae-d0c7-47b1-8f41-4460d4bc1da8 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:03.000514 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6cea8bae-d0c7-47b1-8f41-4460d4bc1da8 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:03.000949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6cea8bae-d0c7-47b1-8f41-4460d4bc1da8 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:03.123321 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-6cea8bae-d0c7-47b1-8f41-4460d4bc1da8 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:03.131140 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-6cea8bae-d0c7-47b1-8f41-4460d4bc1da8 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:03.132647 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-6cea8bae-d0c7-47b1-8f41-4460d4bc1da8 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:03.133820 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-6cea8bae-d0c7-47b1-8f41-4460d4bc1da8 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.145571 May 12 11:47:03.134377 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 162/308] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:02 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:47:03.638490 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-e81de44b-6346-4b59-9c44-c814358a1e33 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:03.639144 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-e81de44b-6346-4b59-9c44-c814358a1e33 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:03.645546 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e81de44b-6346-4b59-9c44-c814358a1e33 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:03.646029 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e81de44b-6346-4b59-9c44-c814358a1e33 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:03.646799 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e81de44b-6346-4b59-9c44-c814358a1e33 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:03.647234 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e81de44b-6346-4b59-9c44-c814358a1e33 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:03.694755 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b7b0fc2a-8c85-47cd-9faa-03d2c3f6bcfe tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:03.695507 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-b7b0fc2a-8c85-47cd-9faa-03d2c3f6bcfe tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:03.701754 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b7b0fc2a-8c85-47cd-9faa-03d2c3f6bcfe tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:03.702211 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b7b0fc2a-8c85-47cd-9faa-03d2c3f6bcfe tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:03.702983 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b7b0fc2a-8c85-47cd-9faa-03d2c3f6bcfe tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:03.703427 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b7b0fc2a-8c85-47cd-9faa-03d2c3f6bcfe tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:03.779633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-e81de44b-6346-4b59-9c44-c814358a1e33 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:03.787029 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-e81de44b-6346-4b59-9c44-c814358a1e33 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.152396 May 12 11:47:03.787601 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 147/309] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:03 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:03.830830 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b7b0fc2a-8c85-47cd-9faa-03d2c3f6bcfe tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:03.838559 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-b7b0fc2a-8c85-47cd-9faa-03d2c3f6bcfe tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.147027 May 12 11:47:03.839118 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 163/310] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:03 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:03.844036 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-ae1a5e29-648b-49b9-8160-0b800df7c83d tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:03.844652 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-ae1a5e29-648b-49b9-8160-0b800df7c83d tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:03.850687 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ae1a5e29-648b-49b9-8160-0b800df7c83d tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:03.851134 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ae1a5e29-648b-49b9-8160-0b800df7c83d tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:03.851896 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ae1a5e29-648b-49b9-8160-0b800df7c83d tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:03.852330 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ae1a5e29-648b-49b9-8160-0b800df7c83d tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:03.980013 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-ae1a5e29-648b-49b9-8160-0b800df7c83d tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:03.987965 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-ae1a5e29-648b-49b9-8160-0b800df7c83d tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1314 microversion: 2.1 time: 0.147690 May 12 11:47:03.989207 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 148/311] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:03 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:04.152133 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-6b8f0614-537b-4d9b-9a9a-bc07e9094d8d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:04.152660 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-6b8f0614-537b-4d9b-9a9a-bc07e9094d8d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:04.158586 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6b8f0614-537b-4d9b-9a9a-bc07e9094d8d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:04.159030 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6b8f0614-537b-4d9b-9a9a-bc07e9094d8d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:04.159779 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6b8f0614-537b-4d9b-9a9a-bc07e9094d8d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:04.160212 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6b8f0614-537b-4d9b-9a9a-bc07e9094d8d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:04.292862 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-6b8f0614-537b-4d9b-9a9a-bc07e9094d8d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:04.300512 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-6b8f0614-537b-4d9b-9a9a-bc07e9094d8d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:04.302024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-6b8f0614-537b-4d9b-9a9a-bc07e9094d8d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:04.303164 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-6b8f0614-537b-4d9b-9a9a-bc07e9094d8d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.154927 May 12 11:47:04.303720 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 164/312] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:04 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:04.804064 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-6458446f-7bb1-4fe6-ba1b-81265b5cb3d7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:04.804692 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-6458446f-7bb1-4fe6-ba1b-81265b5cb3d7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:04.811015 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6458446f-7bb1-4fe6-ba1b-81265b5cb3d7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:04.811459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6458446f-7bb1-4fe6-ba1b-81265b5cb3d7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:04.812211 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6458446f-7bb1-4fe6-ba1b-81265b5cb3d7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:04.812646 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6458446f-7bb1-4fe6-ba1b-81265b5cb3d7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:04.856070 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-0c46d3f9-0680-4823-9c5c-4a730fe13c33 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:04.856679 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-0c46d3f9-0680-4823-9c5c-4a730fe13c33 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:04.862919 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0c46d3f9-0680-4823-9c5c-4a730fe13c33 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:04.863359 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0c46d3f9-0680-4823-9c5c-4a730fe13c33 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:04.864109 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0c46d3f9-0680-4823-9c5c-4a730fe13c33 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:04.864538 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0c46d3f9-0680-4823-9c5c-4a730fe13c33 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:04.946510 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-6458446f-7bb1-4fe6-ba1b-81265b5cb3d7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:04.955554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-6458446f-7bb1-4fe6-ba1b-81265b5cb3d7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.155224 May 12 11:47:04.956096 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 149/313] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:04 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:04.998388 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-0c46d3f9-0680-4823-9c5c-4a730fe13c33 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:05.004585 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-a0db11fe-4a81-427a-97d8-be5cbba20ad4 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:05.005197 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-a0db11fe-4a81-427a-97d8-be5cbba20ad4 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:05.005664 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-0c46d3f9-0680-4823-9c5c-4a730fe13c33 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.154052 May 12 11:47:05.015464 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 165/314] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:04 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:05.015747 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a0db11fe-4a81-427a-97d8-be5cbba20ad4 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:05.015747 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a0db11fe-4a81-427a-97d8-be5cbba20ad4 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:05.015747 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a0db11fe-4a81-427a-97d8-be5cbba20ad4 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:05.015747 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a0db11fe-4a81-427a-97d8-be5cbba20ad4 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:05.144328 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-a0db11fe-4a81-427a-97d8-be5cbba20ad4 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:05.152622 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-a0db11fe-4a81-427a-97d8-be5cbba20ad4 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1314 microversion: 2.1 time: 0.151517 May 12 11:47:05.153377 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 150/315] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:04 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:05.323918 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-c9d47c97-6c7e-48ba-8bb4-2e0516c95030 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:05.324648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-c9d47c97-6c7e-48ba-8bb4-2e0516c95030 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:05.331605 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c9d47c97-6c7e-48ba-8bb4-2e0516c95030 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:05.332120 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c9d47c97-6c7e-48ba-8bb4-2e0516c95030 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:05.333099 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c9d47c97-6c7e-48ba-8bb4-2e0516c95030 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:05.333760 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c9d47c97-6c7e-48ba-8bb4-2e0516c95030 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:05.507776 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c9d47c97-6c7e-48ba-8bb4-2e0516c95030 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:05.516316 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c9d47c97-6c7e-48ba-8bb4-2e0516c95030 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:05.518115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c9d47c97-6c7e-48ba-8bb4-2e0516c95030 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:05.519340 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-c9d47c97-6c7e-48ba-8bb4-2e0516c95030 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.201574 May 12 11:47:05.519970 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 166/316] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:05 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:05.977333 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-ebee4e3c-929c-4d31-bf3f-0d397f165763 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:05.979081 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-ebee4e3c-929c-4d31-bf3f-0d397f165763 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:05.999922 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ebee4e3c-929c-4d31-bf3f-0d397f165763 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:06.002057 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ebee4e3c-929c-4d31-bf3f-0d397f165763 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:06.003084 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ebee4e3c-929c-4d31-bf3f-0d397f165763 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:06.003687 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ebee4e3c-929c-4d31-bf3f-0d397f165763 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:06.022621 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-92c98893-5fd4-4632-877c-0e661059837c tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:06.023354 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-92c98893-5fd4-4632-877c-0e661059837c tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:06.029675 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-92c98893-5fd4-4632-877c-0e661059837c tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:06.030094 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-92c98893-5fd4-4632-877c-0e661059837c tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:06.031036 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-92c98893-5fd4-4632-877c-0e661059837c tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:06.031467 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-92c98893-5fd4-4632-877c-0e661059837c tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:06.141468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-ebee4e3c-929c-4d31-bf3f-0d397f165763 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:06.148965 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-ebee4e3c-929c-4d31-bf3f-0d397f165763 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1500 microversion: 2.1 time: 0.179982 May 12 11:47:06.149534 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 151/317] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:05 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1500 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:06.165109 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-13b559e7-ea94-4d6c-9cc9-7aa89860168d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a3a1cd3-6cc0-44b5-8b1c-75b02382727f"}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:47:06.166310 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-13b559e7-ea94-4d6c-9cc9-7aa89860168d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:06.172153 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-13b559e7-ea94-4d6c-9cc9-7aa89860168d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:06.172604 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-13b559e7-ea94-4d6c-9cc9-7aa89860168d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:06.173371 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-13b559e7-ea94-4d6c-9cc9-7aa89860168d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:06.173828 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-13b559e7-ea94-4d6c-9cc9-7aa89860168d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:06.177176 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-92c98893-5fd4-4632-877c-0e661059837c tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:06.185273 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-92c98893-5fd4-4632-877c-0e661059837c tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.166487 May 12 11:47:06.194591 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 167/318] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:06 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:06.194591 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-d0299a83-e320-4915-8bf8-48f48705a2b9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:06.194591 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d0299a83-e320-4915-8bf8-48f48705a2b9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:06.197995 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d0299a83-e320-4915-8bf8-48f48705a2b9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:06.198462 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d0299a83-e320-4915-8bf8-48f48705a2b9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:06.198956 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-13b559e7-ea94-4d6c-9cc9-7aa89860168d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] HTTP exception thrown: Cannot 'attach_volume' instance 337fca44-29a2-43fd-bc5f-092ad95c83f8 while it is in vm_state rescued May 12 11:47:06.199296 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d0299a83-e320-4915-8bf8-48f48705a2b9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:06.199735 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d0299a83-e320-4915-8bf8-48f48705a2b9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:06.201217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-13b559e7-ea94-4d6c-9cc9-7aa89860168d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Request method failure captured: May 12 11:47:06.201217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: POST /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8/os-volume_attachments HTTP/1.1 May 12 11:47:06.201217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:47:06.201217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:47:06.201217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:47:06.201217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 74 May 12 11:47:06.201217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:47:06.201217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:47:06.201217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:47:06.201217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:47:06.201217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPNGiEbPp1EKOPM8sNNzsWH98UxNn4UhORk8h08QbSY1P98NX0wWcAMF--kKN9Sfif9Yy8ydOqvtWecpYzdDjBj7nMFaod6Rdr76MtudieQbbdR4fJr20z_3SgdOIL7B907xiJQ5HNOYIzBktDwljSn0ORqCfq8kCZ8WTAtnO6fO0B4 May 12 11:47:06.201217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:47:06.201217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:47:06.201217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:47:06.201217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:47:06.201217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:47:06.201217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:47:06.201217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: dd154e9ddff14089b8fc96ba030e5669 May 12 11:47:06.201217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1383743525 May 12 11:47:06.201217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:47:06.201217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:47:06.202691 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd154e9ddff14089b8fc96ba030e5669"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd154e9ddff14089b8fc96ba030e5669"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd154e9ddff14089b8fc96ba030e5669"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd154e9ddff14089b8fc96ba030e5669", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:47:06.202691 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1383743525 May 12 11:47:06.202691 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: dd154e9ddff14089b8fc96ba030e5669 May 12 11:47:06.202691 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1383743525 May 12 11:47:06.202691 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-ServerRescueNegativeTestJSON-1383743525-project May 12 11:47:06.202691 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:47:06.202691 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:47:06.202691 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: af0e1282e6024c9c8f128a8d7b235733 May 12 11:47:06.202691 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1383743525-project May 12 11:47:06.202691 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: May 12 11:47:06.202691 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {"volumeAttachment": {"volumeId": "1a3a1cd3-6cc0-44b5-8b1c-75b02382727f"}} May 12 11:47:06.202691 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: > May 12 11:47:06.203970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Cannot 'attach_volume' instance 337fca44-29a2-43fd-bc5f-092ad95c83f8 while it is in vm_state rescued May 12 11:47:06.203970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'server_id': '337fca44-29a2-43fd-bc5f-092ad95c83f8', 'body': {'volumeAttachment': {'volumeId': '1a3a1cd3-6cc0-44b5-8b1c-75b02382727f'}}} May 12 11:47:06.203970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:47:06.203970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:47:06.203970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 11:47:06.203970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 11:47:06.203970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 11:47:06.203970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 11:47:06.203970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 12 11:47:06.203970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 12 11:47:06.203970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 337fca44-29a2-43fd-bc5f-092ad95c83f8 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 12 11:47:06.203970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:47:06.203970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:47:06.203970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:47:06.203970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:47:06.203970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:47:06.203970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:47:06.203970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:47:06.203970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:47:06.205322 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:47:06.205322 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:47:06.205322 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 11:47:06.205322 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 11:47:06.205322 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 11:47:06.205322 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 11:47:06.205322 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 11:47:06.205322 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 11:47:06.205322 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 12 11:47:06.205322 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 12 11:47:06.205322 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 12 11:47:06.205322 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 12 11:47:06.205322 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 337fca44-29a2-43fd-bc5f-092ad95c83f8 while it is in vm_state rescued May 12 11:47:06.205322 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:47:06.205322 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:47:06.205322 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:47:06.205322 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:47:06.205322 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:47:06.205322 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:47:06.207311 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:47:06.207311 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:47:06.207311 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 337fca44-29a2-43fd-bc5f-092ad95c83f8 while it is in vm_state rescued May 12 11:47:06.207311 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:47:06.207311 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-13b559e7-ea94-4d6c-9cc9-7aa89860168d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Returning 409 to user: Cannot 'attach_volume' instance 337fca44-29a2-43fd-bc5f-092ad95c83f8 while it is in vm_state rescued {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:47:06.207311 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-13b559e7-ea94-4d6c-9cc9-7aa89860168d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "POST /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041364 May 12 11:47:06.207311 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 152/319] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 12 11:47:06 2022] POST /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 12 11:47:06.211194 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-0c06de7c-e880-45fa-ad8e-b17371eb73c7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:47:06.211716 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-0c06de7c-e880-45fa-ad8e-b17371eb73c7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:06.217550 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0c06de7c-e880-45fa-ad8e-b17371eb73c7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:06.218029 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0c06de7c-e880-45fa-ad8e-b17371eb73c7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:06.218795 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0c06de7c-e880-45fa-ad8e-b17371eb73c7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:06.219229 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0c06de7c-e880-45fa-ad8e-b17371eb73c7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:06.290331 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-0c06de7c-e880-45fa-ad8e-b17371eb73c7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "POST /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8/action" status: 202 len: 0 microversion: 2.1 time: 0.082502 May 12 11:47:06.291659 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 153/320] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 12 11:47:06 2022] POST /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:47:06.299878 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-5c18a524-e6e7-4519-8455-26c05488e5f6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:06.300562 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-5c18a524-e6e7-4519-8455-26c05488e5f6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:06.307354 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5c18a524-e6e7-4519-8455-26c05488e5f6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:06.307867 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5c18a524-e6e7-4519-8455-26c05488e5f6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:06.308566 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5c18a524-e6e7-4519-8455-26c05488e5f6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:06.309000 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5c18a524-e6e7-4519-8455-26c05488e5f6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:06.337462 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-d0299a83-e320-4915-8bf8-48f48705a2b9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:06.345820 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-d0299a83-e320-4915-8bf8-48f48705a2b9 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1314 microversion: 2.1 time: 0.158473 May 12 11:47:06.346401 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 168/321] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:06 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:06.443155 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-5c18a524-e6e7-4519-8455-26c05488e5f6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:06.450512 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-5c18a524-e6e7-4519-8455-26c05488e5f6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1508 microversion: 2.1 time: 0.154694 May 12 11:47:06.451869 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 154/322] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:06 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:06.537387 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a11feead-4dea-4077-a403-5c467676fef6 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:06.537956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-a11feead-4dea-4077-a403-5c467676fef6 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:06.544338 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a11feead-4dea-4077-a403-5c467676fef6 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:06.544786 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a11feead-4dea-4077-a403-5c467676fef6 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:06.545567 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a11feead-4dea-4077-a403-5c467676fef6 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:06.546024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a11feead-4dea-4077-a403-5c467676fef6 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:06.672848 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-a11feead-4dea-4077-a403-5c467676fef6 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:06.680248 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-a11feead-4dea-4077-a403-5c467676fef6 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:06.681955 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-a11feead-4dea-4077-a403-5c467676fef6 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:06.683115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-a11feead-4dea-4077-a403-5c467676fef6 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.149677 May 12 11:47:06.683663 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 169/323] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:06 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:07.203479 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-63023ec0-07b6-45cd-8a55-2045b5b1787f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:07.204214 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-63023ec0-07b6-45cd-8a55-2045b5b1787f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:07.210584 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-63023ec0-07b6-45cd-8a55-2045b5b1787f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:07.211084 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-63023ec0-07b6-45cd-8a55-2045b5b1787f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:07.211972 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-63023ec0-07b6-45cd-8a55-2045b5b1787f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:07.212482 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-63023ec0-07b6-45cd-8a55-2045b5b1787f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:07.344059 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-63023ec0-07b6-45cd-8a55-2045b5b1787f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:07.352071 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-63023ec0-07b6-45cd-8a55-2045b5b1787f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.153390 May 12 11:47:07.352573 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 155/324] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:07 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:07.364056 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-d86d3b9c-bdb5-4005-b8d7-13887e759b9b tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:07.364663 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d86d3b9c-bdb5-4005-b8d7-13887e759b9b tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:07.371221 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d86d3b9c-bdb5-4005-b8d7-13887e759b9b tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:07.371668 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d86d3b9c-bdb5-4005-b8d7-13887e759b9b tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:07.372436 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d86d3b9c-bdb5-4005-b8d7-13887e759b9b tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:07.372867 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d86d3b9c-bdb5-4005-b8d7-13887e759b9b tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:07.468873 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-45a763a9-b628-49ab-b334-116e34cc8028 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:07.469487 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-45a763a9-b628-49ab-b334-116e34cc8028 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:07.475463 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-45a763a9-b628-49ab-b334-116e34cc8028 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:07.475917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-45a763a9-b628-49ab-b334-116e34cc8028 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:07.476690 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-45a763a9-b628-49ab-b334-116e34cc8028 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:07.477135 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-45a763a9-b628-49ab-b334-116e34cc8028 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:07.518698 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-d86d3b9c-bdb5-4005-b8d7-13887e759b9b tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:07.525894 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-d86d3b9c-bdb5-4005-b8d7-13887e759b9b tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1314 microversion: 2.1 time: 0.165781 May 12 11:47:07.526972 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 170/325] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:07 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:07.608295 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-45a763a9-b628-49ab-b334-116e34cc8028 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:07.615525 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-45a763a9-b628-49ab-b334-116e34cc8028 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1508 microversion: 2.1 time: 0.150491 May 12 11:47:07.616083 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 156/326] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:07 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:07.701645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-8d5cc766-0b2b-4d42-9e71-b9e8613c54dc tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:07.702369 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-8d5cc766-0b2b-4d42-9e71-b9e8613c54dc tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:07.708579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8d5cc766-0b2b-4d42-9e71-b9e8613c54dc tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:07.709034 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8d5cc766-0b2b-4d42-9e71-b9e8613c54dc tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:07.709873 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8d5cc766-0b2b-4d42-9e71-b9e8613c54dc tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:07.710345 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8d5cc766-0b2b-4d42-9e71-b9e8613c54dc tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:07.845345 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8d5cc766-0b2b-4d42-9e71-b9e8613c54dc tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:07.853348 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8d5cc766-0b2b-4d42-9e71-b9e8613c54dc tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:07.854925 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8d5cc766-0b2b-4d42-9e71-b9e8613c54dc tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:07.856134 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-8d5cc766-0b2b-4d42-9e71-b9e8613c54dc tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.158878 May 12 11:47:07.856632 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 171/327] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:07 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:08.369598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-21e9870c-e619-4823-8c7b-d5d7816cbcbc tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:08.371001 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-21e9870c-e619-4823-8c7b-d5d7816cbcbc tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:08.377447 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-21e9870c-e619-4823-8c7b-d5d7816cbcbc tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:08.378039 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-21e9870c-e619-4823-8c7b-d5d7816cbcbc tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:08.378919 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-21e9870c-e619-4823-8c7b-d5d7816cbcbc tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:08.379352 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-21e9870c-e619-4823-8c7b-d5d7816cbcbc tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:08.514724 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-21e9870c-e619-4823-8c7b-d5d7816cbcbc tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:08.522735 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-21e9870c-e619-4823-8c7b-d5d7816cbcbc tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.156731 May 12 11:47:08.523317 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 157/328] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:08 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:08.543472 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-29282d55-6328-444f-9b14-95cf2be7094d tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:08.544078 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-29282d55-6328-444f-9b14-95cf2be7094d tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:08.549864 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-29282d55-6328-444f-9b14-95cf2be7094d tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:08.550304 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-29282d55-6328-444f-9b14-95cf2be7094d tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:08.551222 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-29282d55-6328-444f-9b14-95cf2be7094d tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:08.551657 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-29282d55-6328-444f-9b14-95cf2be7094d tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:08.632218 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-c9851599-7e28-4613-8128-616eba97e0ff tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:08.632834 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-c9851599-7e28-4613-8128-616eba97e0ff tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:08.638873 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c9851599-7e28-4613-8128-616eba97e0ff tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:08.639326 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c9851599-7e28-4613-8128-616eba97e0ff tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:08.640101 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c9851599-7e28-4613-8128-616eba97e0ff tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:08.640539 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c9851599-7e28-4613-8128-616eba97e0ff tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:08.676384 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-29282d55-6328-444f-9b14-95cf2be7094d tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:08.684334 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-29282d55-6328-444f-9b14-95cf2be7094d tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1314 microversion: 2.1 time: 0.145200 May 12 11:47:08.684902 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 172/329] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:08 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:08.764516 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-c9851599-7e28-4613-8128-616eba97e0ff tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:08.771703 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-c9851599-7e28-4613-8128-616eba97e0ff tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1508 microversion: 2.1 time: 0.143279 May 12 11:47:08.772265 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 158/330] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:08 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1508 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:08.874654 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-9e1dd64d-1e8b-4f5c-a970-9d6b610044ef tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:08.875335 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-9e1dd64d-1e8b-4f5c-a970-9d6b610044ef tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:08.881369 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9e1dd64d-1e8b-4f5c-a970-9d6b610044ef tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:08.882013 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9e1dd64d-1e8b-4f5c-a970-9d6b610044ef tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:08.882777 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9e1dd64d-1e8b-4f5c-a970-9d6b610044ef tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:08.883208 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9e1dd64d-1e8b-4f5c-a970-9d6b610044ef tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:09.015023 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-9e1dd64d-1e8b-4f5c-a970-9d6b610044ef tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:09.022700 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-9e1dd64d-1e8b-4f5c-a970-9d6b610044ef tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:09.024185 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-9e1dd64d-1e8b-4f5c-a970-9d6b610044ef tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:09.025322 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-9e1dd64d-1e8b-4f5c-a970-9d6b610044ef tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.155609 May 12 11:47:09.025903 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 173/331] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:08 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:47:09.539627 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-dcf299c4-8520-44db-9678-b713779d56f3 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:09.540409 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-dcf299c4-8520-44db-9678-b713779d56f3 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:09.548158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-dcf299c4-8520-44db-9678-b713779d56f3 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:09.548603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-dcf299c4-8520-44db-9678-b713779d56f3 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:09.549369 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-dcf299c4-8520-44db-9678-b713779d56f3 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:09.549828 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-dcf299c4-8520-44db-9678-b713779d56f3 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:09.685529 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-dcf299c4-8520-44db-9678-b713779d56f3 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:09.693422 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-dcf299c4-8520-44db-9678-b713779d56f3 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.157708 May 12 11:47:09.694016 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 159/332] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:09 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:09.701670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-69df44f7-4e8a-4cbd-b3a5-eecec996d8c4 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:09.702397 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-69df44f7-4e8a-4cbd-b3a5-eecec996d8c4 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:09.708393 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-69df44f7-4e8a-4cbd-b3a5-eecec996d8c4 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:09.708921 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-69df44f7-4e8a-4cbd-b3a5-eecec996d8c4 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:09.709790 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-69df44f7-4e8a-4cbd-b3a5-eecec996d8c4 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:09.710574 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-69df44f7-4e8a-4cbd-b3a5-eecec996d8c4 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:09.788461 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-0254dbe6-faeb-4d9f-bbfc-c792a4da41c4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:09.789468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-0254dbe6-faeb-4d9f-bbfc-c792a4da41c4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:09.796085 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0254dbe6-faeb-4d9f-bbfc-c792a4da41c4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:09.796893 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0254dbe6-faeb-4d9f-bbfc-c792a4da41c4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:09.797778 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0254dbe6-faeb-4d9f-bbfc-c792a4da41c4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:09.798291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0254dbe6-faeb-4d9f-bbfc-c792a4da41c4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:09.910530 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-69df44f7-4e8a-4cbd-b3a5-eecec996d8c4 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:09.918991 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-69df44f7-4e8a-4cbd-b3a5-eecec996d8c4 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1314 microversion: 2.1 time: 0.221771 May 12 11:47:09.919718 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 174/333] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:09 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:09.959487 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-0254dbe6-faeb-4d9f-bbfc-c792a4da41c4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:09.966986 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-0254dbe6-faeb-4d9f-bbfc-c792a4da41c4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1508 microversion: 2.1 time: 0.182315 May 12 11:47:09.969775 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 160/334] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:09 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:10.043923 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-8cdc7ff9-a8f0-4c23-89d2-cf19213408ac tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:10.044523 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-8cdc7ff9-a8f0-4c23-89d2-cf19213408ac tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:10.050227 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8cdc7ff9-a8f0-4c23-89d2-cf19213408ac tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:10.050683 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8cdc7ff9-a8f0-4c23-89d2-cf19213408ac tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:10.051446 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8cdc7ff9-a8f0-4c23-89d2-cf19213408ac tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:10.051885 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8cdc7ff9-a8f0-4c23-89d2-cf19213408ac tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:10.181521 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8cdc7ff9-a8f0-4c23-89d2-cf19213408ac tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:10.190052 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8cdc7ff9-a8f0-4c23-89d2-cf19213408ac tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:10.191578 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8cdc7ff9-a8f0-4c23-89d2-cf19213408ac tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:10.192782 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-8cdc7ff9-a8f0-4c23-89d2-cf19213408ac tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.153230 May 12 11:47:10.193339 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 175/335] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:10 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:10.711325 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-7e0bf4dd-00a1-4212-a141-594fe3d0d1f2 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:10.711980 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-7e0bf4dd-00a1-4212-a141-594fe3d0d1f2 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:10.719487 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7e0bf4dd-00a1-4212-a141-594fe3d0d1f2 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:10.719970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7e0bf4dd-00a1-4212-a141-594fe3d0d1f2 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:10.720820 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7e0bf4dd-00a1-4212-a141-594fe3d0d1f2 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:10.721498 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7e0bf4dd-00a1-4212-a141-594fe3d0d1f2 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:10.862750 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-7e0bf4dd-00a1-4212-a141-594fe3d0d1f2 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:10.870641 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-7e0bf4dd-00a1-4212-a141-594fe3d0d1f2 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.163255 May 12 11:47:10.871230 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 161/336] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:10 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:10.935866 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-fafd0975-0946-481c-b214-53f41193a973 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:10.936477 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-fafd0975-0946-481c-b214-53f41193a973 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:10.942555 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fafd0975-0946-481c-b214-53f41193a973 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:10.943005 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fafd0975-0946-481c-b214-53f41193a973 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:10.943769 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fafd0975-0946-481c-b214-53f41193a973 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:10.944208 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fafd0975-0946-481c-b214-53f41193a973 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:10.985257 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-36dbfd0f-8694-4c7e-a813-75e80574021d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:10.985443 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-36dbfd0f-8694-4c7e-a813-75e80574021d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:10.992377 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-36dbfd0f-8694-4c7e-a813-75e80574021d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:10.992913 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-36dbfd0f-8694-4c7e-a813-75e80574021d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:10.993834 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-36dbfd0f-8694-4c7e-a813-75e80574021d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:10.994334 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-36dbfd0f-8694-4c7e-a813-75e80574021d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:11.075213 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-fafd0975-0946-481c-b214-53f41193a973 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:11.082876 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-fafd0975-0946-481c-b214-53f41193a973 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1314 microversion: 2.1 time: 0.150800 May 12 11:47:11.083453 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 176/337] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:10 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:11.118935 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-36dbfd0f-8694-4c7e-a813-75e80574021d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:11.126809 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-36dbfd0f-8694-4c7e-a813-75e80574021d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1508 microversion: 2.1 time: 0.146424 May 12 11:47:11.127373 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 162/338] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:10 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:11.211777 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-5dcf07ab-4c28-4e24-8ffa-9032d4bf2d5c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:11.212382 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-5dcf07ab-4c28-4e24-8ffa-9032d4bf2d5c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:11.219345 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5dcf07ab-4c28-4e24-8ffa-9032d4bf2d5c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:11.219795 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5dcf07ab-4c28-4e24-8ffa-9032d4bf2d5c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:11.220612 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5dcf07ab-4c28-4e24-8ffa-9032d4bf2d5c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:11.221046 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5dcf07ab-4c28-4e24-8ffa-9032d4bf2d5c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:11.345822 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-5dcf07ab-4c28-4e24-8ffa-9032d4bf2d5c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:11.353485 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-5dcf07ab-4c28-4e24-8ffa-9032d4bf2d5c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:11.355592 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-5dcf07ab-4c28-4e24-8ffa-9032d4bf2d5c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:11.356744 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-5dcf07ab-4c28-4e24-8ffa-9032d4bf2d5c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.148923 May 12 11:47:11.357304 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 177/339] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:11 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:11.887604 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-4178d3b5-4781-41df-b0e4-fc6eba4ada28 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:11.888153 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-4178d3b5-4781-41df-b0e4-fc6eba4ada28 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:11.894385 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4178d3b5-4781-41df-b0e4-fc6eba4ada28 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:11.894830 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4178d3b5-4781-41df-b0e4-fc6eba4ada28 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:11.895587 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4178d3b5-4781-41df-b0e4-fc6eba4ada28 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:11.896021 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4178d3b5-4781-41df-b0e4-fc6eba4ada28 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:12.024275 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-4178d3b5-4781-41df-b0e4-fc6eba4ada28 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:12.031955 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-4178d3b5-4781-41df-b0e4-fc6eba4ada28 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.148233 May 12 11:47:12.032504 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 163/340] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:11 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:12.099339 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ee52fcab-b6e4-4dc5-a565-f746d70d643c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:12.099948 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-ee52fcab-b6e4-4dc5-a565-f746d70d643c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:12.106390 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ee52fcab-b6e4-4dc5-a565-f746d70d643c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:12.106843 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ee52fcab-b6e4-4dc5-a565-f746d70d643c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:12.107604 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ee52fcab-b6e4-4dc5-a565-f746d70d643c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:12.108034 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ee52fcab-b6e4-4dc5-a565-f746d70d643c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:12.143523 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-c54a3c66-f600-46ab-aae3-7ee02bd0ee40 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:12.144043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-c54a3c66-f600-46ab-aae3-7ee02bd0ee40 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:12.149949 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c54a3c66-f600-46ab-aae3-7ee02bd0ee40 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:12.150399 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c54a3c66-f600-46ab-aae3-7ee02bd0ee40 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:12.151708 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c54a3c66-f600-46ab-aae3-7ee02bd0ee40 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:12.152136 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c54a3c66-f600-46ab-aae3-7ee02bd0ee40 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:12.233242 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-ee52fcab-b6e4-4dc5-a565-f746d70d643c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:12.240631 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-ee52fcab-b6e4-4dc5-a565-f746d70d643c tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1314 microversion: 2.1 time: 0.145082 May 12 11:47:12.241193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 178/341] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:12 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:12.283064 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-c54a3c66-f600-46ab-aae3-7ee02bd0ee40 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:12.291233 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-c54a3c66-f600-46ab-aae3-7ee02bd0ee40 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1508 microversion: 2.1 time: 0.151532 May 12 11:47:12.291803 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 164/342] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:12 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:12.374584 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-5d512b45-c0ef-4eda-9171-08325d68fee2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:12.375193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-5d512b45-c0ef-4eda-9171-08325d68fee2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:12.381017 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5d512b45-c0ef-4eda-9171-08325d68fee2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:12.381465 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5d512b45-c0ef-4eda-9171-08325d68fee2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:12.382251 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5d512b45-c0ef-4eda-9171-08325d68fee2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:12.382690 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5d512b45-c0ef-4eda-9171-08325d68fee2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:12.508154 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-5d512b45-c0ef-4eda-9171-08325d68fee2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:12.516330 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-5d512b45-c0ef-4eda-9171-08325d68fee2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:12.517921 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-5d512b45-c0ef-4eda-9171-08325d68fee2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:12.519075 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-5d512b45-c0ef-4eda-9171-08325d68fee2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.148337 May 12 11:47:12.519632 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 179/343] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:12 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:13.048203 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-9e73ebd4-dd43-4078-9d13-d4b5a5178bb4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:13.048817 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-9e73ebd4-dd43-4078-9d13-d4b5a5178bb4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:13.055145 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9e73ebd4-dd43-4078-9d13-d4b5a5178bb4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:13.055593 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9e73ebd4-dd43-4078-9d13-d4b5a5178bb4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:13.056356 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9e73ebd4-dd43-4078-9d13-d4b5a5178bb4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:13.056820 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9e73ebd4-dd43-4078-9d13-d4b5a5178bb4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:13.180155 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-9e73ebd4-dd43-4078-9d13-d4b5a5178bb4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:13.187286 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-9e73ebd4-dd43-4078-9d13-d4b5a5178bb4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.142897 May 12 11:47:13.187855 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 165/344] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:13 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:13.256071 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-096eeaf9-258d-4602-96c5-bdf5093be4cb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:13.256676 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-096eeaf9-258d-4602-96c5-bdf5093be4cb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:13.262944 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-096eeaf9-258d-4602-96c5-bdf5093be4cb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:13.263384 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-096eeaf9-258d-4602-96c5-bdf5093be4cb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:13.264138 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-096eeaf9-258d-4602-96c5-bdf5093be4cb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:13.264569 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-096eeaf9-258d-4602-96c5-bdf5093be4cb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:13.308206 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-58f361a7-0a53-4a05-8766-18b414ce3d43 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:13.308824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-58f361a7-0a53-4a05-8766-18b414ce3d43 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:13.314686 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-58f361a7-0a53-4a05-8766-18b414ce3d43 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:13.315138 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-58f361a7-0a53-4a05-8766-18b414ce3d43 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:13.315913 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-58f361a7-0a53-4a05-8766-18b414ce3d43 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:13.316358 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-58f361a7-0a53-4a05-8766-18b414ce3d43 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:13.397498 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-096eeaf9-258d-4602-96c5-bdf5093be4cb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:13.404903 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-096eeaf9-258d-4602-96c5-bdf5093be4cb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1314 microversion: 2.1 time: 0.152593 May 12 11:47:13.405472 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 180/345] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:13 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:13.446216 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-58f361a7-0a53-4a05-8766-18b414ce3d43 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:13.454560 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-58f361a7-0a53-4a05-8766-18b414ce3d43 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1508 microversion: 2.1 time: 0.150170 May 12 11:47:13.455132 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 166/346] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:13 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:13.536520 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-327ad6a1-7c3a-4762-b678-55e405f9e985 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:13.537123 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-327ad6a1-7c3a-4762-b678-55e405f9e985 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:13.543055 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-327ad6a1-7c3a-4762-b678-55e405f9e985 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:13.543501 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-327ad6a1-7c3a-4762-b678-55e405f9e985 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:13.544261 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-327ad6a1-7c3a-4762-b678-55e405f9e985 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:13.544697 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-327ad6a1-7c3a-4762-b678-55e405f9e985 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:13.669262 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-327ad6a1-7c3a-4762-b678-55e405f9e985 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:13.677082 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-327ad6a1-7c3a-4762-b678-55e405f9e985 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:13.678612 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-327ad6a1-7c3a-4762-b678-55e405f9e985 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:13.679893 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-327ad6a1-7c3a-4762-b678-55e405f9e985 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.147118 May 12 11:47:13.680295 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 181/347] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:13 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:14.203970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-6b2dc498-711a-4305-ade3-700077fb91d4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:14.204580 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-6b2dc498-711a-4305-ade3-700077fb91d4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:14.210898 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6b2dc498-711a-4305-ade3-700077fb91d4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:14.211371 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6b2dc498-711a-4305-ade3-700077fb91d4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:14.212116 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6b2dc498-711a-4305-ade3-700077fb91d4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:14.212554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6b2dc498-711a-4305-ade3-700077fb91d4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:14.340226 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-6b2dc498-711a-4305-ade3-700077fb91d4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:14.347446 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-6b2dc498-711a-4305-ade3-700077fb91d4 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.147613 May 12 11:47:14.348011 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 167/348] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:14 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:14.421691 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-3cc7d612-7309-4673-8175-99098e6e0475 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:14.422313 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-3cc7d612-7309-4673-8175-99098e6e0475 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:14.428073 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3cc7d612-7309-4673-8175-99098e6e0475 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:14.428515 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3cc7d612-7309-4673-8175-99098e6e0475 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:14.429388 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3cc7d612-7309-4673-8175-99098e6e0475 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:14.429854 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3cc7d612-7309-4673-8175-99098e6e0475 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:14.470494 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-d1df5bb8-5683-4aaa-8610-1ec8ae828c42 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:14.471016 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d1df5bb8-5683-4aaa-8610-1ec8ae828c42 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:14.478217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d1df5bb8-5683-4aaa-8610-1ec8ae828c42 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:14.478700 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d1df5bb8-5683-4aaa-8610-1ec8ae828c42 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:14.480045 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d1df5bb8-5683-4aaa-8610-1ec8ae828c42 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:14.480681 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d1df5bb8-5683-4aaa-8610-1ec8ae828c42 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:14.575522 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-3cc7d612-7309-4673-8175-99098e6e0475 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:14.583561 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-3cc7d612-7309-4673-8175-99098e6e0475 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1314 microversion: 2.1 time: 0.165538 May 12 11:47:14.584742 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 182/349] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:14 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:14.619688 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-d1df5bb8-5683-4aaa-8610-1ec8ae828c42 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:14.627135 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-d1df5bb8-5683-4aaa-8610-1ec8ae828c42 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1508 microversion: 2.1 time: 0.160290 May 12 11:47:14.627715 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 168/350] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:14 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:14.699477 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-4d954fbb-4569-460c-b85b-c10e81648811 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:14.700087 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-4d954fbb-4569-460c-b85b-c10e81648811 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:14.708112 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4d954fbb-4569-460c-b85b-c10e81648811 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:14.708670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4d954fbb-4569-460c-b85b-c10e81648811 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:14.709526 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4d954fbb-4569-460c-b85b-c10e81648811 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:14.710052 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4d954fbb-4569-460c-b85b-c10e81648811 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:14.793742 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-df641902-83c7-40c7-89b1-21dada4a34b1 req-71a8c1c3-1d94-4bc1-bd7b-d11a70863aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a03ef4f-9cf8-4749-8eb8-9077d5987909", "name": "network-vif-plugged", "status": "completed", "tag": "5467d5f0-8b8e-4bbd-967c-8638230e171e"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:47:14.802422 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-df641902-83c7-40c7-89b1-21dada4a34b1 req-71a8c1c3-1d94-4bc1-bd7b-d11a70863aaf service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:14.802952 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-df641902-83c7-40c7-89b1-21dada4a34b1 req-71a8c1c3-1d94-4bc1-bd7b-d11a70863aaf service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:14.814344 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-df641902-83c7-40c7-89b1-21dada4a34b1 req-71a8c1c3-1d94-4bc1-bd7b-d11a70863aaf service nova] Creating event network-vif-plugged:5467d5f0-8b8e-4bbd-967c-8638230e171e for instance 3a03ef4f-9cf8-4749-8eb8-9077d5987909 on hv-cinder-80473 May 12 11:47:14.819739 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-df641902-83c7-40c7-89b1-21dada4a34b1 req-71a8c1c3-1d94-4bc1-bd7b-d11a70863aaf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031083 May 12 11:47:14.820609 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 169/351] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:47:14.843513 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-4d954fbb-4569-460c-b85b-c10e81648811 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:14.851379 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-4d954fbb-4569-460c-b85b-c10e81648811 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:14.852886 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-4d954fbb-4569-460c-b85b-c10e81648811 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:14.854137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-4d954fbb-4569-460c-b85b-c10e81648811 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.159365 May 12 11:47:14.854683 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 183/352] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:14 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:15.365279 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-71d5f434-e276-4ffa-8a1c-9741ed150d8f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:15.366037 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-71d5f434-e276-4ffa-8a1c-9741ed150d8f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:15.373333 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-71d5f434-e276-4ffa-8a1c-9741ed150d8f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:15.373822 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-71d5f434-e276-4ffa-8a1c-9741ed150d8f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:15.374965 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-71d5f434-e276-4ffa-8a1c-9741ed150d8f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:15.375096 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-71d5f434-e276-4ffa-8a1c-9741ed150d8f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:15.503407 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-71d5f434-e276-4ffa-8a1c-9741ed150d8f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:15.510810 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-71d5f434-e276-4ffa-8a1c-9741ed150d8f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.149741 May 12 11:47:15.511442 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 170/353] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:15 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:15.601070 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-5052f287-dfdb-4e41-ac9d-80f6561de5f0 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:15.601666 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-5052f287-dfdb-4e41-ac9d-80f6561de5f0 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:15.607994 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5052f287-dfdb-4e41-ac9d-80f6561de5f0 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:15.608437 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5052f287-dfdb-4e41-ac9d-80f6561de5f0 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:15.609185 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5052f287-dfdb-4e41-ac9d-80f6561de5f0 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:15.609613 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5052f287-dfdb-4e41-ac9d-80f6561de5f0 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:15.644196 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-4463b3b8-79a9-47f3-93a5-fba024110e5f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:15.644912 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-4463b3b8-79a9-47f3-93a5-fba024110e5f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:15.651524 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4463b3b8-79a9-47f3-93a5-fba024110e5f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:15.652061 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4463b3b8-79a9-47f3-93a5-fba024110e5f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:15.652961 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4463b3b8-79a9-47f3-93a5-fba024110e5f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:15.653464 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4463b3b8-79a9-47f3-93a5-fba024110e5f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:15.734721 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-5052f287-dfdb-4e41-ac9d-80f6561de5f0 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:15.742141 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-5052f287-dfdb-4e41-ac9d-80f6561de5f0 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1314 microversion: 2.1 time: 0.144774 May 12 11:47:15.742796 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 184/354] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:15 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:15.778939 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-4463b3b8-79a9-47f3-93a5-fba024110e5f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:15.786108 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-4463b3b8-79a9-47f3-93a5-fba024110e5f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1514 microversion: 2.1 time: 0.145624 May 12 11:47:15.786671 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 171/355] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:15 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:15.872130 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-6828dc5c-8a85-4524-9360-47846f57e661 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:15.872738 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-6828dc5c-8a85-4524-9360-47846f57e661 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:15.878483 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6828dc5c-8a85-4524-9360-47846f57e661 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:15.878931 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6828dc5c-8a85-4524-9360-47846f57e661 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:15.879689 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6828dc5c-8a85-4524-9360-47846f57e661 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:15.880120 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6828dc5c-8a85-4524-9360-47846f57e661 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:16.010694 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-6828dc5c-8a85-4524-9360-47846f57e661 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:16.020942 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-6828dc5c-8a85-4524-9360-47846f57e661 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:16.023079 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-6828dc5c-8a85-4524-9360-47846f57e661 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:16.024634 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-6828dc5c-8a85-4524-9360-47846f57e661 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.156305 May 12 11:47:16.035309 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 185/356] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:15 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:16.527044 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-500714a9-afe1-41de-9999-791729b3c35a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:16.527682 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-500714a9-afe1-41de-9999-791729b3c35a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:16.534005 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-500714a9-afe1-41de-9999-791729b3c35a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:16.534455 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-500714a9-afe1-41de-9999-791729b3c35a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:16.535229 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-500714a9-afe1-41de-9999-791729b3c35a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:16.535668 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-500714a9-afe1-41de-9999-791729b3c35a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:16.694106 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-500714a9-afe1-41de-9999-791729b3c35a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:16.702260 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-500714a9-afe1-41de-9999-791729b3c35a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1358 microversion: 2.1 time: 0.179156 May 12 11:47:16.703179 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 172/357] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:16 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:16.758446 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-bb42c463-c908-4fd4-977d-10eb01cb73fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:16.759055 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-bb42c463-c908-4fd4-977d-10eb01cb73fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:16.765046 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bb42c463-c908-4fd4-977d-10eb01cb73fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:16.765493 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bb42c463-c908-4fd4-977d-10eb01cb73fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:16.766356 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bb42c463-c908-4fd4-977d-10eb01cb73fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:16.766861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bb42c463-c908-4fd4-977d-10eb01cb73fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:16.835808 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-bb9f4c47-2f11-49ed-844b-1d46a8212858 req-c3dbba95-44a5-4342-ab34-f6576d6f2108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea", "name": "network-vif-plugged", "status": "completed", "tag": "82b8454d-541b-4f2e-8c06-d39a1129aabb"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:47:16.843569 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-bb9f4c47-2f11-49ed-844b-1d46a8212858 req-c3dbba95-44a5-4342-ab34-f6576d6f2108 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:16.844011 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-bb9f4c47-2f11-49ed-844b-1d46a8212858 req-c3dbba95-44a5-4342-ab34-f6576d6f2108 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:16.855468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-bb9f4c47-2f11-49ed-844b-1d46a8212858 req-c3dbba95-44a5-4342-ab34-f6576d6f2108 service nova] Creating event network-vif-plugged:82b8454d-541b-4f2e-8c06-d39a1129aabb for instance 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea on hv-cinder-80473 May 12 11:47:16.860303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-bb9f4c47-2f11-49ed-844b-1d46a8212858 req-c3dbba95-44a5-4342-ab34-f6576d6f2108 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027993 May 12 11:47:16.860916 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 173/358] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:47:16.899115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-bb42c463-c908-4fd4-977d-10eb01cb73fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:16.906345 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-bb42c463-c908-4fd4-977d-10eb01cb73fb tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1314 microversion: 2.1 time: 0.151941 May 12 11:47:16.906908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 186/359] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:16 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:17.044672 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-deb2a35f-1c49-40ed-90ce-3f2584c91485 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:17.045375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-deb2a35f-1c49-40ed-90ce-3f2584c91485 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:17.051591 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-deb2a35f-1c49-40ed-90ce-3f2584c91485 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:17.052042 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-deb2a35f-1c49-40ed-90ce-3f2584c91485 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:17.052837 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-deb2a35f-1c49-40ed-90ce-3f2584c91485 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:17.053272 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-deb2a35f-1c49-40ed-90ce-3f2584c91485 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:17.115885 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-410d0587-def3-4378-9382-afaf3a527a64 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Action: 'create', calling method: .version_select at 0x7f29f2f929d0>, body: {"keypair": {"name": "tempest-keypair-2105373298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEW5COIOWS9tjkhUTu4NpClfI520HQsa3pF2F7yoEH+KqmWG83vMxz9uMQ7Fb+aIAsH75FFroyrOsi/yhQGqwWYGzueaufHm1lnVQj3dJfZAe/vqIVndn6FwT9xZTn7eBw=="}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:47:17.134291 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-410d0587-def3-4378-9382-afaf3a527a64 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Getting quotas for project dd154e9ddff14089b8fc96ba030e5669. Resources: {'key_pairs'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:47:17.138171 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-410d0587-def3-4378-9382-afaf3a527a64 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Getting quotas for user af0e1282e6024c9c8f128a8d7b235733 and project dd154e9ddff14089b8fc96ba030e5669. Resources: {'key_pairs'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:47:17.179533 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-410d0587-def3-4378-9382-afaf3a527a64 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.067199 May 12 11:47:17.180346 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 187/360] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 12 11:47:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:47:17.192859 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-deb2a35f-1c49-40ed-90ce-3f2584c91485 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:17.201093 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-deb2a35f-1c49-40ed-90ce-3f2584c91485 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:17.202858 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-deb2a35f-1c49-40ed-90ce-3f2584c91485 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:17.205321 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-deb2a35f-1c49-40ed-90ce-3f2584c91485 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.165018 May 12 11:47:17.206311 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 174/361] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:17 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:17.722247 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-8a452b49-a4a5-4dd4-8fa6-7a33f48eef00 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:17.722897 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-8a452b49-a4a5-4dd4-8fa6-7a33f48eef00 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:17.728756 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8a452b49-a4a5-4dd4-8fa6-7a33f48eef00 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:17.729205 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8a452b49-a4a5-4dd4-8fa6-7a33f48eef00 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:17.730012 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8a452b49-a4a5-4dd4-8fa6-7a33f48eef00 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:17.730452 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8a452b49-a4a5-4dd4-8fa6-7a33f48eef00 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:17.922640 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-11ad4269-fb19-41c3-90c9-7ef447037a3a tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:17.923254 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-11ad4269-fb19-41c3-90c9-7ef447037a3a tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:17.929753 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-11ad4269-fb19-41c3-90c9-7ef447037a3a tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:17.930198 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-11ad4269-fb19-41c3-90c9-7ef447037a3a tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:17.930965 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-11ad4269-fb19-41c3-90c9-7ef447037a3a tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:17.936162 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-11ad4269-fb19-41c3-90c9-7ef447037a3a tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:17.984567 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8a452b49-a4a5-4dd4-8fa6-7a33f48eef00 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:17.995608 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-8a452b49-a4a5-4dd4-8fa6-7a33f48eef00 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1546 microversion: 2.1 time: 0.276380 May 12 11:47:17.996804 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 188/362] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:17 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1546 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:18.013543 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-9df54672-b117-4029-a7da-827636d42f2a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:18.014408 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-9df54672-b117-4029-a7da-827636d42f2a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:18.020259 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9df54672-b117-4029-a7da-827636d42f2a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:18.020920 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9df54672-b117-4029-a7da-827636d42f2a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:18.022164 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9df54672-b117-4029-a7da-827636d42f2a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:18.022672 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9df54672-b117-4029-a7da-827636d42f2a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:18.077942 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-11ad4269-fb19-41c3-90c9-7ef447037a3a tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:18.085327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-11ad4269-fb19-41c3-90c9-7ef447037a3a tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1314 microversion: 2.1 time: 0.166576 May 12 11:47:18.085917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 175/363] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:17 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:18.207644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-9df54672-b117-4029-a7da-827636d42f2a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:18.215133 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-9df54672-b117-4029-a7da-827636d42f2a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1546 microversion: 2.1 time: 0.206223 May 12 11:47:18.215896 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 189/364] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:18 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1546 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:18.224633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-a61f8702-78ce-4646-95c8-0120e735af33 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:18.225416 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-a61f8702-78ce-4646-95c8-0120e735af33 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:18.231916 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b49f0ee7-1257-4bdb-b824-60791b4ffc16 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:18.232701 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a61f8702-78ce-4646-95c8-0120e735af33 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:18.233266 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a61f8702-78ce-4646-95c8-0120e735af33 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:18.234285 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a61f8702-78ce-4646-95c8-0120e735af33 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:18.234966 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a61f8702-78ce-4646-95c8-0120e735af33 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:18.235379 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b49f0ee7-1257-4bdb-b824-60791b4ffc16 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:18.236156 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-b49f0ee7-1257-4bdb-b824-60791b4ffc16 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Searching by: {'deleted': False, 'project_id': '95636bf5a2284bc697044d2b3b46828a'} {{(pid=123508) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 12 11:47:18.242625 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b49f0ee7-1257-4bdb-b824-60791b4ffc16 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:18.243069 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b49f0ee7-1257-4bdb-b824-60791b4ffc16 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:18.243881 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b49f0ee7-1257-4bdb-b824-60791b4ffc16 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:18.244321 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b49f0ee7-1257-4bdb-b824-60791b4ffc16 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:18.352190 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.multi_cell_list [None req-b49f0ee7-1257-4bdb-b824-60791b4ffc16 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123508) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 12 11:47:18.379705 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-a61f8702-78ce-4646-95c8-0120e735af33 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:18.388636 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-a61f8702-78ce-4646-95c8-0120e735af33 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:18.390528 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-a61f8702-78ce-4646-95c8-0120e735af33 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:18.392092 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-a61f8702-78ce-4646-95c8-0120e735af33 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1743 microversion: 2.20 time: 0.171563 May 12 11:47:18.393379 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 176/365] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:18 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:47:18.458581 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-b49f0ee7-1257-4bdb-b824-60791b4ffc16 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.231084 May 12 11:47:18.459434 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 190/366] 10.222.0.58 () {58 vars in 1124 bytes} [Thu May 12 11:47:18 2022] GET /compute/v2.1/servers => generated 343 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:47:18.471409 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-36c884e0-4878-417c-98d1-8371eb98ef5d tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:18.472689 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-36c884e0-4878-417c-98d1-8371eb98ef5d tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:18.480262 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-36c884e0-4878-417c-98d1-8371eb98ef5d tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:18.480725 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-36c884e0-4878-417c-98d1-8371eb98ef5d tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:18.481843 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-36c884e0-4878-417c-98d1-8371eb98ef5d tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:18.482538 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-36c884e0-4878-417c-98d1-8371eb98ef5d tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:18.630219 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-36c884e0-4878-417c-98d1-8371eb98ef5d tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:18.642968 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-36c884e0-4878-417c-98d1-8371eb98ef5d tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1546 microversion: 2.1 time: 0.176412 May 12 11:47:18.644171 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 177/367] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:18 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1546 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:18.812999 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-18f615f7-cbe8-427f-9f28-373592cbe51e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-917538454", "imageRef": "576e8b7b-771b-47aa-89c6-ff04accc9bea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d9c73724-1128-42dd-9a6f-5e6f5ee490dc"}], "security_groups": [{"name": "tempest-securitygroup--1032445325"}], "key_name": "tempest-keypair-2105373298", "user_data": "}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:47:18.921609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.network.neutron [None req-18f615f7-cbe8-427f-9f28-373592cbe51e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] validate_networks() for [('d9c73724-1128-42dd-9a6f-5e6f5ee490dc', None, None, None, None, None)] {{(pid=123508) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 11:47:19.103020 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-2966e9d1-4d8d-4552-ac54-9d55b8f134be tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:19.104480 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-2966e9d1-4d8d-4552-ac54-9d55b8f134be tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:19.110915 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2966e9d1-4d8d-4552-ac54-9d55b8f134be tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:19.111362 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2966e9d1-4d8d-4552-ac54-9d55b8f134be tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:19.112326 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2966e9d1-4d8d-4552-ac54-9d55b8f134be tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:19.112766 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2966e9d1-4d8d-4552-ac54-9d55b8f134be tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:19.268062 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-2966e9d1-4d8d-4552-ac54-9d55b8f134be tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:19.275671 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-2966e9d1-4d8d-4552-ac54-9d55b8f134be tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1314 microversion: 2.1 time: 0.176399 May 12 11:47:19.276957 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 178/368] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:19 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:19.323445 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-18f615f7-cbe8-427f-9f28-373592cbe51e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Flavor limits 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 11:47:19.323866 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-18f615f7-cbe8-427f-9f28-373592cbe51e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Image limits 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 11:47:19.324311 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-18f615f7-cbe8-427f-9f28-373592cbe51e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Flavor pref 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 11:47:19.324710 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-18f615f7-cbe8-427f-9f28-373592cbe51e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Image pref 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 11:47:19.325137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-18f615f7-cbe8-427f-9f28-373592cbe51e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 11:47:19.335093 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-18f615f7-cbe8-427f-9f28-373592cbe51e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:19.335558 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-18f615f7-cbe8-427f-9f28-373592cbe51e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:19.336369 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-18f615f7-cbe8-427f-9f28-373592cbe51e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:19.336811 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-18f615f7-cbe8-427f-9f28-373592cbe51e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:19.353554 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-18f615f7-cbe8-427f-9f28-373592cbe51e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Getting quotas for project dd154e9ddff14089b8fc96ba030e5669. Resources: {'ram', 'cores', 'instances'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:47:19.357327 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-18f615f7-cbe8-427f-9f28-373592cbe51e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Getting quotas for user af0e1282e6024c9c8f128a8d7b235733 and project dd154e9ddff14089b8fc96ba030e5669. Resources: {'ram', 'cores', 'instances'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:47:19.372050 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-18f615f7-cbe8-427f-9f28-373592cbe51e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Going to run 1 instances... {{(pid=123508) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 11:47:19.374233 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-18f615f7-cbe8-427f-9f28-373592cbe51e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='576e8b7b-771b-47aa-89c6-ff04accc9bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 11:47:19.411497 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-14322020-4078-49e0-8778-4b18b9fcbf21 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:19.412273 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-14322020-4078-49e0-8778-4b18b9fcbf21 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:19.419025 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-14322020-4078-49e0-8778-4b18b9fcbf21 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:19.419482 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-14322020-4078-49e0-8778-4b18b9fcbf21 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:19.420255 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-14322020-4078-49e0-8778-4b18b9fcbf21 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:19.420697 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-14322020-4078-49e0-8778-4b18b9fcbf21 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:19.430522 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-18f615f7-cbe8-427f-9f28-373592cbe51e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.621807 May 12 11:47:19.437199 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 191/369] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 12 11:47:18 2022] POST /compute/v2.1/servers => generated 409 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 11:47:19.442130 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-09f9a04c-85ab-4fcb-99ab-37d64ed87846 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:19.442750 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-09f9a04c-85ab-4fcb-99ab-37d64ed87846 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:19.514248 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-09f9a04c-85ab-4fcb-99ab-37d64ed87846 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:19.523834 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-09f9a04c-85ab-4fcb-99ab-37d64ed87846 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1245 microversion: 2.1 time: 0.085506 May 12 11:47:19.524541 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 192/370] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:19 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:19.597994 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-14322020-4078-49e0-8778-4b18b9fcbf21 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:19.610681 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-14322020-4078-49e0-8778-4b18b9fcbf21 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:19.612438 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-14322020-4078-49e0-8778-4b18b9fcbf21 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:19.613629 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-14322020-4078-49e0-8778-4b18b9fcbf21 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1743 microversion: 2.20 time: 0.207013 May 12 11:47:19.614389 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 179/371] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:19 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1743 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:47:20.219775 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-e7e3e753-22b4-4b91-a999-8c32b7ad5718 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea034f2b-de66-41f3-ba33-d015d67222d0"}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:47:20.220936 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-e7e3e753-22b4-4b91-a999-8c32b7ad5718 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:20.235029 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e7e3e753-22b4-4b91-a999-8c32b7ad5718 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:20.235477 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e7e3e753-22b4-4b91-a999-8c32b7ad5718 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:20.236246 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e7e3e753-22b4-4b91-a999-8c32b7ad5718 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:20.236844 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e7e3e753-22b4-4b91-a999-8c32b7ad5718 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:20.293156 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-70f0e7ef-ccf5-4cc4-ac37-c442b9d00cc1 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:20.293982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-70f0e7ef-ccf5-4cc4-ac37-c442b9d00cc1 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:20.300247 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-70f0e7ef-ccf5-4cc4-ac37-c442b9d00cc1 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:20.300690 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-70f0e7ef-ccf5-4cc4-ac37-c442b9d00cc1 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:20.301455 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-70f0e7ef-ccf5-4cc4-ac37-c442b9d00cc1 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:20.301912 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-70f0e7ef-ccf5-4cc4-ac37-c442b9d00cc1 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:20.443993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-70f0e7ef-ccf5-4cc4-ac37-c442b9d00cc1 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:20.451947 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-70f0e7ef-ccf5-4cc4-ac37-c442b9d00cc1 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1498 microversion: 2.1 time: 0.163458 May 12 11:47:20.452525 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 180/372] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:20 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1498 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:20.540304 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-36408df7-ca18-469c-bbab-cc54bf86fd9d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:20.541001 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-36408df7-ca18-469c-bbab-cc54bf86fd9d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:20.546866 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-36408df7-ca18-469c-bbab-cc54bf86fd9d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:20.547397 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-36408df7-ca18-469c-bbab-cc54bf86fd9d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:20.548253 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-36408df7-ca18-469c-bbab-cc54bf86fd9d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:20.548697 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-36408df7-ca18-469c-bbab-cc54bf86fd9d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:20.609232 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-36408df7-ca18-469c-bbab-cc54bf86fd9d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:20.616480 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-36408df7-ca18-469c-bbab-cc54bf86fd9d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1297 microversion: 2.1 time: 0.080063 May 12 11:47:20.617061 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 181/373] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:20 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1297 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:20.631944 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-990819af-7fc2-4aaf-959b-13afb5d670f3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:20.632548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-990819af-7fc2-4aaf-959b-13afb5d670f3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:20.638818 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-990819af-7fc2-4aaf-959b-13afb5d670f3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:20.639273 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-990819af-7fc2-4aaf-959b-13afb5d670f3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:20.640045 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-990819af-7fc2-4aaf-959b-13afb5d670f3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:20.640482 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-990819af-7fc2-4aaf-959b-13afb5d670f3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:20.768660 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-990819af-7fc2-4aaf-959b-13afb5d670f3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:20.777272 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-990819af-7fc2-4aaf-959b-13afb5d670f3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:20.778934 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-990819af-7fc2-4aaf-959b-13afb5d670f3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:20.780093 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-990819af-7fc2-4aaf-959b-13afb5d670f3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1743 microversion: 2.20 time: 0.151859 May 12 11:47:20.780652 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 182/374] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:20 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:47:21.008905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-e7e3e753-22b4-4b91-a999-8c32b7ad5718 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "POST /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.792770 May 12 11:47:21.011242 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 193/375] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 12 11:47:20 2022] POST /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909/os-volume_attachments => generated 194 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:47:21.287540 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-718149d9-3fe6-4f40-a019-55073e206154 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:21.288042 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-718149d9-3fe6-4f40-a019-55073e206154 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:21.302748 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-718149d9-3fe6-4f40-a019-55073e206154 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:21.303357 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-718149d9-3fe6-4f40-a019-55073e206154 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:21.303966 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-718149d9-3fe6-4f40-a019-55073e206154 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:21.304408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-718149d9-3fe6-4f40-a019-55073e206154 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:21.368223 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-718149d9-3fe6-4f40-a019-55073e206154 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Going to try to terminate instance {{(pid=123507) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 11:47:21.452145 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-718149d9-3fe6-4f40-a019-55073e206154 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 204 len: 0 microversion: 2.1 time: 0.175230 May 12 11:47:21.452834 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 183/376] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:47:21 2022] DELETE /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 11:47:21.461760 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-35e00e34-7d4d-475e-bbcf-6af022c8ee71 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:21.462514 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-35e00e34-7d4d-475e-bbcf-6af022c8ee71 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:21.468621 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-35e00e34-7d4d-475e-bbcf-6af022c8ee71 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:21.469067 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-35e00e34-7d4d-475e-bbcf-6af022c8ee71 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:21.469872 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-35e00e34-7d4d-475e-bbcf-6af022c8ee71 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:21.470308 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-35e00e34-7d4d-475e-bbcf-6af022c8ee71 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:21.634133 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-08a8a0ff-95f3-4243-b321-2645015d0745 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:21.634772 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-08a8a0ff-95f3-4243-b321-2645015d0745 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:21.642063 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-08a8a0ff-95f3-4243-b321-2645015d0745 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:21.643005 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-08a8a0ff-95f3-4243-b321-2645015d0745 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:21.644027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-08a8a0ff-95f3-4243-b321-2645015d0745 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:21.644860 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-08a8a0ff-95f3-4243-b321-2645015d0745 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:21.696530 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-35e00e34-7d4d-475e-bbcf-6af022c8ee71 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:21.704958 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-35e00e34-7d4d-475e-bbcf-6af022c8ee71 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1504 microversion: 2.1 time: 0.247632 May 12 11:47:21.706178 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 194/377] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:21 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1504 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:21.725119 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-08a8a0ff-95f3-4243-b321-2645015d0745 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:21.732954 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-08a8a0ff-95f3-4243-b321-2645015d0745 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1303 microversion: 2.1 time: 0.103340 May 12 11:47:21.733526 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 184/378] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:21 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:21.798662 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-5ce53cbf-a0e5-4f3a-af7d-1198ca79af98 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:21.799179 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-5ce53cbf-a0e5-4f3a-af7d-1198ca79af98 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:21.805323 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5ce53cbf-a0e5-4f3a-af7d-1198ca79af98 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:21.805802 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5ce53cbf-a0e5-4f3a-af7d-1198ca79af98 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:21.806565 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5ce53cbf-a0e5-4f3a-af7d-1198ca79af98 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:21.807034 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5ce53cbf-a0e5-4f3a-af7d-1198ca79af98 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:22.027274 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-5ce53cbf-a0e5-4f3a-af7d-1198ca79af98 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:22.034975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-5ce53cbf-a0e5-4f3a-af7d-1198ca79af98 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:22.036473 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-5ce53cbf-a0e5-4f3a-af7d-1198ca79af98 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:22.037613 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-5ce53cbf-a0e5-4f3a-af7d-1198ca79af98 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1738 microversion: 2.20 time: 0.242970 May 12 11:47:22.038390 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 195/379] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:21 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1738 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:22.673256 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-54fa2080-1bc0-4341-b721-75f6d8041ea2 req-a836c133-8c7c-45bc-8443-34263804225e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5cd2aad-2374-4ded-8b72-2e54fbbad916", "name": "network-vif-plugged", "status": "completed", "tag": "d3632d97-f0ea-41b4-9003-a50ffebf91df"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:47:22.682673 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-54fa2080-1bc0-4341-b721-75f6d8041ea2 req-a836c133-8c7c-45bc-8443-34263804225e service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:22.683189 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-54fa2080-1bc0-4341-b721-75f6d8041ea2 req-a836c133-8c7c-45bc-8443-34263804225e service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:22.695340 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-54fa2080-1bc0-4341-b721-75f6d8041ea2 req-a836c133-8c7c-45bc-8443-34263804225e service nova] Creating event network-vif-plugged:d3632d97-f0ea-41b4-9003-a50ffebf91df for instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 on hv-cinder-80473 May 12 11:47:22.700803 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-54fa2080-1bc0-4341-b721-75f6d8041ea2 req-a836c133-8c7c-45bc-8443-34263804225e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031185 May 12 11:47:22.701646 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 185/380] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:47:22.723450 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-8ecd0620-6791-4d89-9369-2f36444a495b tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:22.724065 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-8ecd0620-6791-4d89-9369-2f36444a495b tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:22.731056 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8ecd0620-6791-4d89-9369-2f36444a495b tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:22.731513 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8ecd0620-6791-4d89-9369-2f36444a495b tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:22.732284 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8ecd0620-6791-4d89-9369-2f36444a495b tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:22.732724 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8ecd0620-6791-4d89-9369-2f36444a495b tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:22.751219 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-9d20f712-9fd5-4063-bc50-983512349dc1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:22.752001 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-9d20f712-9fd5-4063-bc50-983512349dc1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:22.759096 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9d20f712-9fd5-4063-bc50-983512349dc1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:22.759644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9d20f712-9fd5-4063-bc50-983512349dc1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:22.760809 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9d20f712-9fd5-4063-bc50-983512349dc1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:22.761348 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9d20f712-9fd5-4063-bc50-983512349dc1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:22.878996 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8ecd0620-6791-4d89-9369-2f36444a495b tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:22.887131 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-8ecd0620-6791-4d89-9369-2f36444a495b tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1504 microversion: 2.1 time: 0.167645 May 12 11:47:22.887832 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 196/381] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:22 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:22.907961 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-9d20f712-9fd5-4063-bc50-983512349dc1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:22.915307 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-9d20f712-9fd5-4063-bc50-983512349dc1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1371 microversion: 2.1 time: 0.168633 May 12 11:47:22.915864 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 186/382] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:22 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:23.058051 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-548b1560-731c-41ae-81ca-69676a86771e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:23.058778 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-548b1560-731c-41ae-81ca-69676a86771e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:23.067224 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-548b1560-731c-41ae-81ca-69676a86771e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:23.067814 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-548b1560-731c-41ae-81ca-69676a86771e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:23.068688 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-548b1560-731c-41ae-81ca-69676a86771e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:23.069229 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-548b1560-731c-41ae-81ca-69676a86771e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:23.208463 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-548b1560-731c-41ae-81ca-69676a86771e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:23.217265 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-548b1560-731c-41ae-81ca-69676a86771e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:23.218994 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-548b1560-731c-41ae-81ca-69676a86771e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:23.220162 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-548b1560-731c-41ae-81ca-69676a86771e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1738 microversion: 2.20 time: 0.168193 May 12 11:47:23.220847 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 197/383] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:23 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:23.911094 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-7fd7c707-9490-470a-aa0c-3ec4d7565100 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:23.912432 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-7fd7c707-9490-470a-aa0c-3ec4d7565100 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:23.932800 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-fa63568b-b04a-45aa-8fdb-7483d0a51b4d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:23.933671 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-fa63568b-b04a-45aa-8fdb-7483d0a51b4d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:23.942107 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fa63568b-b04a-45aa-8fdb-7483d0a51b4d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:23.942558 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7fd7c707-9490-470a-aa0c-3ec4d7565100 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:23.943093 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7fd7c707-9490-470a-aa0c-3ec4d7565100 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:23.950670 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7fd7c707-9490-470a-aa0c-3ec4d7565100 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:23.951415 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7fd7c707-9490-470a-aa0c-3ec4d7565100 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:23.954093 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fa63568b-b04a-45aa-8fdb-7483d0a51b4d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:23.955120 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fa63568b-b04a-45aa-8fdb-7483d0a51b4d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:23.955618 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fa63568b-b04a-45aa-8fdb-7483d0a51b4d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:24.179603 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-fa63568b-b04a-45aa-8fdb-7483d0a51b4d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:24.187826 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-fa63568b-b04a-45aa-8fdb-7483d0a51b4d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1371 microversion: 2.1 time: 0.259250 May 12 11:47:24.188412 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 198/384] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:23 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1371 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:24.196947 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-60101964-23fe-4432-b474-030f929bfd37 req-e2913e56-1efa-439b-b3b7-44854c00b045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f609a10d-385a-4eb7-92b3-cfd766e53d22", "tag": "2eb78bc7-7875-449d-a6e9-a6f8eebe488c"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:47:24.203710 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-60101964-23fe-4432-b474-030f929bfd37 req-e2913e56-1efa-439b-b3b7-44854c00b045 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:24.204160 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-60101964-23fe-4432-b474-030f929bfd37 req-e2913e56-1efa-439b-b3b7-44854c00b045 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:24.228107 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-60101964-23fe-4432-b474-030f929bfd37 req-e2913e56-1efa-439b-b3b7-44854c00b045 service nova] Creating event network-changed:2eb78bc7-7875-449d-a6e9-a6f8eebe488c for instance f609a10d-385a-4eb7-92b3-cfd766e53d22 on hv-cinder-80473 May 12 11:47:24.236651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-60101964-23fe-4432-b474-030f929bfd37 req-e2913e56-1efa-439b-b3b7-44854c00b045 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046130 May 12 11:47:24.240962 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 199/385] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:47:24.253695 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-86b1f41b-a36d-4670-9f84-50edd9b3ae2c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:24.254622 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-86b1f41b-a36d-4670-9f84-50edd9b3ae2c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:24.261992 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-86b1f41b-a36d-4670-9f84-50edd9b3ae2c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:24.262722 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-86b1f41b-a36d-4670-9f84-50edd9b3ae2c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:24.263662 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-86b1f41b-a36d-4670-9f84-50edd9b3ae2c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:24.264252 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-86b1f41b-a36d-4670-9f84-50edd9b3ae2c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:24.347515 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-7fd7c707-9490-470a-aa0c-3ec4d7565100 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:24.357582 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-7fd7c707-9490-470a-aa0c-3ec4d7565100 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1504 microversion: 2.1 time: 0.456408 May 12 11:47:24.360700 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 187/386] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:23 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1504 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:24.624966 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-86b1f41b-a36d-4670-9f84-50edd9b3ae2c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:24.635091 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-86b1f41b-a36d-4670-9f84-50edd9b3ae2c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:24.642766 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-86b1f41b-a36d-4670-9f84-50edd9b3ae2c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:24.647587 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-86b1f41b-a36d-4670-9f84-50edd9b3ae2c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1738 microversion: 2.20 time: 0.403698 May 12 11:47:24.648586 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 200/387] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:24 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1738 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:24.984828 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-79801967-5e8a-49ce-a9e4-036508e0a88e req-cff74110-20dc-436d-af35-95703f631df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea", "name": "network-vif-deleted", "tag": "82b8454d-541b-4f2e-8c06-d39a1129aabb"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:47:24.999225 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-79801967-5e8a-49ce-a9e4-036508e0a88e req-cff74110-20dc-436d-af35-95703f631df9 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:24.999949 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-79801967-5e8a-49ce-a9e4-036508e0a88e req-cff74110-20dc-436d-af35-95703f631df9 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:25.027416 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-79801967-5e8a-49ce-a9e4-036508e0a88e req-cff74110-20dc-436d-af35-95703f631df9 service nova] Creating event network-vif-deleted:82b8454d-541b-4f2e-8c06-d39a1129aabb for instance 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea on hv-cinder-80473 May 12 11:47:25.038510 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-79801967-5e8a-49ce-a9e4-036508e0a88e req-cff74110-20dc-436d-af35-95703f631df9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057309 May 12 11:47:25.039363 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 188/388] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:47:25.204599 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-7b1d9d57-fcc7-416a-b447-d73a1dc38c54 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:25.205319 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-7b1d9d57-fcc7-416a-b447-d73a1dc38c54 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:25.214143 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7b1d9d57-fcc7-416a-b447-d73a1dc38c54 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:25.214573 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7b1d9d57-fcc7-416a-b447-d73a1dc38c54 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:25.217836 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7b1d9d57-fcc7-416a-b447-d73a1dc38c54 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:25.218458 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7b1d9d57-fcc7-416a-b447-d73a1dc38c54 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:25.378397 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-1d7a918a-d979-4651-a70e-cda7b695d139 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:25.379103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-1d7a918a-d979-4651-a70e-cda7b695d139 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:25.396731 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1d7a918a-d979-4651-a70e-cda7b695d139 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:25.397190 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1d7a918a-d979-4651-a70e-cda7b695d139 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:25.397991 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1d7a918a-d979-4651-a70e-cda7b695d139 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:25.405302 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1d7a918a-d979-4651-a70e-cda7b695d139 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:25.439934 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1d7a918a-d979-4651-a70e-cda7b695d139 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:25.440642 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1d7a918a-d979-4651-a70e-cda7b695d139 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:25.441250 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.objects.instance [None req-1d7a918a-d979-4651-a70e-cda7b695d139 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lazy-loading 'fault' on Instance uuid 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea {{(pid=123507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:47:25.463921 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-7b1d9d57-fcc7-416a-b447-d73a1dc38c54 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:25.474000 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-7b1d9d57-fcc7-416a-b447-d73a1dc38c54 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1371 microversion: 2.1 time: 0.273328 May 12 11:47:25.475668 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 201/389] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:25 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1371 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:25.490446 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-1d7a918a-d979-4651-a70e-cda7b695d139 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47030b2f71c64e8884d1946f4ed2afdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83add10bc914fa2b53b93c94671c2cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:25.499109 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-1d7a918a-d979-4651-a70e-cda7b695d139 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 200 len: 1304 microversion: 2.1 time: 0.126383 May 12 11:47:25.501353 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 189/390] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:25 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 1304 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:25.668055 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-c38f9a81-2683-41f9-9a39-4fd92dcb06ec tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:25.668907 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-c38f9a81-2683-41f9-9a39-4fd92dcb06ec tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:25.675515 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c38f9a81-2683-41f9-9a39-4fd92dcb06ec tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:25.676304 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c38f9a81-2683-41f9-9a39-4fd92dcb06ec tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:25.677379 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c38f9a81-2683-41f9-9a39-4fd92dcb06ec tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:25.678026 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c38f9a81-2683-41f9-9a39-4fd92dcb06ec tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:25.811472 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-68485337-1701-472a-9816-c9d6dc6f296f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:25.812319 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-68485337-1701-472a-9816-c9d6dc6f296f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:25.823412 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-68485337-1701-472a-9816-c9d6dc6f296f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:25.824072 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-68485337-1701-472a-9816-c9d6dc6f296f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:25.825077 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-68485337-1701-472a-9816-c9d6dc6f296f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:25.825667 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-68485337-1701-472a-9816-c9d6dc6f296f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:26.009863 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-68485337-1701-472a-9816-c9d6dc6f296f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:26.018562 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-68485337-1701-472a-9816-c9d6dc6f296f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1592 microversion: 2.1 time: 0.212323 May 12 11:47:26.019481 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 190/391] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:25 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1592 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:26.274826 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c38f9a81-2683-41f9-9a39-4fd92dcb06ec tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:26.284748 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c38f9a81-2683-41f9-9a39-4fd92dcb06ec tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:26.302684 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c38f9a81-2683-41f9-9a39-4fd92dcb06ec tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:26.307733 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-c38f9a81-2683-41f9-9a39-4fd92dcb06ec tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1738 microversion: 2.20 time: 0.643100 May 12 11:47:26.316046 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 202/392] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:25 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1738 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:26.492015 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-0e292d4c-2dd6-4d30-9b66-9c51bc964a24 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:26.492695 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-0e292d4c-2dd6-4d30-9b66-9c51bc964a24 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:26.511423 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0e292d4c-2dd6-4d30-9b66-9c51bc964a24 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:26.520461 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-c60e34a2-26b9-4c84-8d39-61cbad04d540 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:26.521371 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-c60e34a2-26b9-4c84-8d39-61cbad04d540 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] [instance: 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:26.526472 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0e292d4c-2dd6-4d30-9b66-9c51bc964a24 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:26.527494 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0e292d4c-2dd6-4d30-9b66-9c51bc964a24 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:26.533120 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c60e34a2-26b9-4c84-8d39-61cbad04d540 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:26.533919 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0e292d4c-2dd6-4d30-9b66-9c51bc964a24 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:26.537855 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c60e34a2-26b9-4c84-8d39-61cbad04d540 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:26.538827 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c60e34a2-26b9-4c84-8d39-61cbad04d540 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:26.541684 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c60e34a2-26b9-4c84-8d39-61cbad04d540 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:26.595091 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-c60e34a2-26b9-4c84-8d39-61cbad04d540 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] HTTP exception thrown: Instance 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea could not be found. May 12 11:47:26.596077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-c60e34a2-26b9-4c84-8d39-61cbad04d540 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Request method failure captured: May 12 11:47:26.596077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea HTTP/1.1 May 12 11:47:26.596077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:47:26.596077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:47:26.596077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:47:26.596077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:47:26.596077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:47:26.596077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:47:26.596077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:47:26.596077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:47:26.596077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPOEO2pEgawQFSjLu40R7oRIsR0-Kocm6DBcQebK5c5CAINFizDYZfqdmzT8Hf49zQ6T_xrJIJEYX1LY5Mhp4o1p4BQFPMzlzZ8buDioIy_wVTatps4wrgAggrUTpYqb1rVqmllJ84t_gLPewzK7FpaqNq5ZUg3EX9As5i_xj83SDIQ May 12 11:47:26.596077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:47:26.596077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:47:26.596077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:47:26.596077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:47:26.596077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:47:26.596077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:47:26.596077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: d83add10bc914fa2b53b93c94671c2cd May 12 11:47:26.596077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-VolumesActionsTest-1409713188 May 12 11:47:26.596077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:47:26.596077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:47:26.597673 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d83add10bc914fa2b53b93c94671c2cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d83add10bc914fa2b53b93c94671c2cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d83add10bc914fa2b53b93c94671c2cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d83add10bc914fa2b53b93c94671c2cd", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:47:26.597673 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-VolumesActionsTest-1409713188 May 12 11:47:26.597673 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: d83add10bc914fa2b53b93c94671c2cd May 12 11:47:26.597673 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-VolumesActionsTest-1409713188 May 12 11:47:26.597673 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-VolumesActionsTest-1409713188-project May 12 11:47:26.597673 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:47:26.597673 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:47:26.597673 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 47030b2f71c64e8884d1946f4ed2afdd May 12 11:47:26.597673 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-VolumesActionsTest-1409713188-project May 12 11:47:26.597673 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:47:26.597673 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea could not be found. May 12 11:47:26.597673 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': '3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea'} May 12 11:47:26.598611 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:47:26.598611 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:47:26.598611 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:47:26.598611 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:47:26.598611 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:47:26.598611 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:47:26.598611 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:47:26.598611 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:47:26.598611 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:47:26.598611 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:47:26.598611 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea could not be found. May 12 11:47:26.598611 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:47:26.598611 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:47:26.598611 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:47:26.598611 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:47:26.598611 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:47:26.598611 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:47:26.598611 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:47:26.598611 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:47:26.598611 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:47:26.600193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:47:26.600193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:47:26.600193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:47:26.600193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:47:26.600193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:47:26.600193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:47:26.600193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:47:26.600193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea could not be found. May 12 11:47:26.600193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:47:26.600193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:47:26.600193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:47:26.600193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:47:26.600193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:47:26.600193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:47:26.600193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:47:26.600193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:47:26.600193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea could not be found. May 12 11:47:26.600193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:47:26.601479 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-c60e34a2-26b9-4c84-8d39-61cbad04d540 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] Returning 404 to user: Instance 3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:47:26.601479 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-c60e34a2-26b9-4c84-8d39-61cbad04d540 tempest-VolumesActionsTest-1409713188 tempest-VolumesActionsTest-1409713188-project] 10.222.0.58 "GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea" status: 404 len: 111 microversion: 2.1 time: 0.081087 May 12 11:47:26.605199 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 203/393] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:26 2022] GET /compute/v2.1/servers/3c7e3f9f-746f-4c4a-83cd-09b8bb3fdcea => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 11:47:26.851478 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-0e292d4c-2dd6-4d30-9b66-9c51bc964a24 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:26.861519 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-0e292d4c-2dd6-4d30-9b66-9c51bc964a24 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1371 microversion: 2.1 time: 0.373544 May 12 11:47:26.862134 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 191/394] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:26 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1371 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:27.334142 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-dd836b60-22ab-42e0-8ec6-358952b11baf tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:27.335476 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-dd836b60-22ab-42e0-8ec6-358952b11baf tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:27.345347 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dd836b60-22ab-42e0-8ec6-358952b11baf tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:27.348254 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dd836b60-22ab-42e0-8ec6-358952b11baf tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:27.350925 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dd836b60-22ab-42e0-8ec6-358952b11baf tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:27.352167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dd836b60-22ab-42e0-8ec6-358952b11baf tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:27.605338 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-dd836b60-22ab-42e0-8ec6-358952b11baf tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:27.616872 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-dd836b60-22ab-42e0-8ec6-358952b11baf tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:27.618559 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-dd836b60-22ab-42e0-8ec6-358952b11baf tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:27.620294 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-dd836b60-22ab-42e0-8ec6-358952b11baf tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1738 microversion: 2.20 time: 0.291579 May 12 11:47:27.634067 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 204/395] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:27 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1738 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:27.901523 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-de7b3a02-e85b-42be-9920-1f7012e73e7d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:27.902281 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-de7b3a02-e85b-42be-9920-1f7012e73e7d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:27.908762 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-de7b3a02-e85b-42be-9920-1f7012e73e7d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:27.909340 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-de7b3a02-e85b-42be-9920-1f7012e73e7d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:27.910274 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-de7b3a02-e85b-42be-9920-1f7012e73e7d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:27.910780 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-de7b3a02-e85b-42be-9920-1f7012e73e7d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:28.075212 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-de7b3a02-e85b-42be-9920-1f7012e73e7d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:28.090700 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-de7b3a02-e85b-42be-9920-1f7012e73e7d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1371 microversion: 2.1 time: 0.196013 May 12 11:47:28.091279 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 192/396] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:27 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:28.639238 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-be82893c-c0bf-426a-a055-7cd581367d34 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:28.641209 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-be82893c-c0bf-426a-a055-7cd581367d34 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:28.647691 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-be82893c-c0bf-426a-a055-7cd581367d34 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:28.648488 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-be82893c-c0bf-426a-a055-7cd581367d34 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:28.649432 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-be82893c-c0bf-426a-a055-7cd581367d34 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:28.651558 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-be82893c-c0bf-426a-a055-7cd581367d34 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:28.880334 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-be82893c-c0bf-426a-a055-7cd581367d34 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:28.896356 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-6235606d-cdcf-4783-8b94-7790145745ff req-4d880122-a414-40ec-8e08-2fa5eb230a02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a03ef4f-9cf8-4749-8eb8-9077d5987909", "tag": "5467d5f0-8b8e-4bbd-967c-8638230e171e"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:47:28.914981 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-be82893c-c0bf-426a-a055-7cd581367d34 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:28.919052 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-be82893c-c0bf-426a-a055-7cd581367d34 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:28.923686 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-be82893c-c0bf-426a-a055-7cd581367d34 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1738 microversion: 2.20 time: 0.288430 May 12 11:47:28.935234 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-6235606d-cdcf-4783-8b94-7790145745ff req-4d880122-a414-40ec-8e08-2fa5eb230a02 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:28.935234 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-6235606d-cdcf-4783-8b94-7790145745ff req-4d880122-a414-40ec-8e08-2fa5eb230a02 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:28.938142 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 205/397] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:28 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1738 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:28.956001 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-6235606d-cdcf-4783-8b94-7790145745ff req-4d880122-a414-40ec-8e08-2fa5eb230a02 service nova] Creating event network-changed:5467d5f0-8b8e-4bbd-967c-8638230e171e for instance 3a03ef4f-9cf8-4749-8eb8-9077d5987909 on hv-cinder-80473 May 12 11:47:28.965529 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-6235606d-cdcf-4783-8b94-7790145745ff req-4d880122-a414-40ec-8e08-2fa5eb230a02 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074897 May 12 11:47:28.973141 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 193/398] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:47:29.109029 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-2dbb8574-fb6b-445b-943b-3e5491782a3b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:29.110154 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-2dbb8574-fb6b-445b-943b-3e5491782a3b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:29.143926 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2dbb8574-fb6b-445b-943b-3e5491782a3b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:29.144538 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2dbb8574-fb6b-445b-943b-3e5491782a3b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:29.145214 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2dbb8574-fb6b-445b-943b-3e5491782a3b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:29.145643 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2dbb8574-fb6b-445b-943b-3e5491782a3b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:29.367324 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-2dbb8574-fb6b-445b-943b-3e5491782a3b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:29.378190 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-2dbb8574-fb6b-445b-943b-3e5491782a3b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1371 microversion: 2.1 time: 0.273752 May 12 11:47:29.381750 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 206/399] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:29 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1371 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:29.942835 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-33514e2d-acf2-4cf3-b6dd-48db44249ba4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:29.943679 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-33514e2d-acf2-4cf3-b6dd-48db44249ba4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:29.960225 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-33514e2d-acf2-4cf3-b6dd-48db44249ba4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:29.961124 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-33514e2d-acf2-4cf3-b6dd-48db44249ba4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:29.962193 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-33514e2d-acf2-4cf3-b6dd-48db44249ba4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:29.963381 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-33514e2d-acf2-4cf3-b6dd-48db44249ba4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:30.182153 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-33514e2d-acf2-4cf3-b6dd-48db44249ba4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:30.193153 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-33514e2d-acf2-4cf3-b6dd-48db44249ba4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:30.204008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-33514e2d-acf2-4cf3-b6dd-48db44249ba4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:30.206281 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-33514e2d-acf2-4cf3-b6dd-48db44249ba4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1738 microversion: 2.20 time: 0.267934 May 12 11:47:30.209428 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 194/400] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:29 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1738 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:47:30.275181 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ea0dd4c0-6748-4b88-a13e-8672b84f528b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2140154362"}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:47:30.276410 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-ea0dd4c0-6748-4b88-a13e-8672b84f528b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:30.288894 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ea0dd4c0-6748-4b88-a13e-8672b84f528b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:30.289351 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ea0dd4c0-6748-4b88-a13e-8672b84f528b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:30.290179 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ea0dd4c0-6748-4b88-a13e-8672b84f528b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:30.290620 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ea0dd4c0-6748-4b88-a13e-8672b84f528b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:30.396099 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-0b7e5613-d7a5-4aba-aa7e-db97d5afb3ad tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:30.397231 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-0b7e5613-d7a5-4aba-aa7e-db97d5afb3ad tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:30.412466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0b7e5613-d7a5-4aba-aa7e-db97d5afb3ad tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:30.413203 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0b7e5613-d7a5-4aba-aa7e-db97d5afb3ad tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:30.414293 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0b7e5613-d7a5-4aba-aa7e-db97d5afb3ad tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:30.414881 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0b7e5613-d7a5-4aba-aa7e-db97d5afb3ad tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:30.466205 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.network.security_group_api [None req-ea0dd4c0-6748-4b88-a13e-8672b84f528b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Adding security group 06bb2f2f-3b67-447e-b9d3-94a9680fb745 to port 5467d5f0-8b8e-4bbd-967c-8638230e171e May 12 11:47:30.613903 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-0b7e5613-d7a5-4aba-aa7e-db97d5afb3ad tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:30.623964 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-0b7e5613-d7a5-4aba-aa7e-db97d5afb3ad tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1371 microversion: 2.1 time: 0.231541 May 12 11:47:30.633055 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 195/401] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:30 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:31.236858 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-bc76b266-9183-4f1b-80d6-2bd53ba2f036 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:31.238311 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-bc76b266-9183-4f1b-80d6-2bd53ba2f036 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:31.247232 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bc76b266-9183-4f1b-80d6-2bd53ba2f036 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:31.248012 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bc76b266-9183-4f1b-80d6-2bd53ba2f036 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:31.248992 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bc76b266-9183-4f1b-80d6-2bd53ba2f036 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:31.250286 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bc76b266-9183-4f1b-80d6-2bd53ba2f036 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:31.410803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-ea0dd4c0-6748-4b88-a13e-8672b84f528b tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "POST /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909/action" status: 202 len: 0 microversion: 2.1 time: 1.140000 May 12 11:47:31.411383 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 207/402] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 12 11:47:30 2022] POST /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909/action => generated 0 bytes in 1141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:47:31.421386 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-3a16b12f-ab13-4d31-a721-5622933ae500 req-48e71e74-64f0-4ca3-9e2b-513b12b18fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a03ef4f-9cf8-4749-8eb8-9077d5987909", "tag": "5467d5f0-8b8e-4bbd-967c-8638230e171e"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:47:31.431239 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-3a16b12f-ab13-4d31-a721-5622933ae500 req-48e71e74-64f0-4ca3-9e2b-513b12b18fb0 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:31.431998 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-3a16b12f-ab13-4d31-a721-5622933ae500 req-48e71e74-64f0-4ca3-9e2b-513b12b18fb0 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:31.460277 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-3a16b12f-ab13-4d31-a721-5622933ae500 req-48e71e74-64f0-4ca3-9e2b-513b12b18fb0 service nova] Creating event network-changed:5467d5f0-8b8e-4bbd-967c-8638230e171e for instance 3a03ef4f-9cf8-4749-8eb8-9077d5987909 on hv-cinder-80473 May 12 11:47:31.461751 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-bc76b266-9183-4f1b-80d6-2bd53ba2f036 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:31.469670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-3a16b12f-ab13-4d31-a721-5622933ae500 req-48e71e74-64f0-4ca3-9e2b-513b12b18fb0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053310 May 12 11:47:31.474725 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 208/403] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:47:31.475666 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-bc76b266-9183-4f1b-80d6-2bd53ba2f036 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:31.477588 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-bc76b266-9183-4f1b-80d6-2bd53ba2f036 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:31.479839 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-bc76b266-9183-4f1b-80d6-2bd53ba2f036 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1738 microversion: 2.20 time: 0.246976 May 12 11:47:31.480914 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 196/404] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:31 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1738 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:47:31.481727 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-9bc051a6-afce-4a31-9857-92aac056f8ad tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:31.483436 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-9bc051a6-afce-4a31-9857-92aac056f8ad tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:31.491929 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9bc051a6-afce-4a31-9857-92aac056f8ad tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:31.492550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9bc051a6-afce-4a31-9857-92aac056f8ad tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:31.493347 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9bc051a6-afce-4a31-9857-92aac056f8ad tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:31.494585 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9bc051a6-afce-4a31-9857-92aac056f8ad tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:31.641578 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-54135dfe-55d6-4e59-a59b-35d933785323 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:31.642520 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-54135dfe-55d6-4e59-a59b-35d933785323 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:31.661885 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-54135dfe-55d6-4e59-a59b-35d933785323 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:31.663485 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-54135dfe-55d6-4e59-a59b-35d933785323 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:31.668021 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-54135dfe-55d6-4e59-a59b-35d933785323 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:31.668864 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-54135dfe-55d6-4e59-a59b-35d933785323 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:31.799706 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-9bc051a6-afce-4a31-9857-92aac056f8ad tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:31.807748 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-9bc051a6-afce-4a31-9857-92aac056f8ad tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1639 microversion: 2.1 time: 0.331749 May 12 11:47:31.808337 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 209/405] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:31 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1639 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:31.961903 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-54135dfe-55d6-4e59-a59b-35d933785323 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:31.981158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-54135dfe-55d6-4e59-a59b-35d933785323 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1371 microversion: 2.1 time: 0.343469 May 12 11:47:31.982007 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 197/406] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:31 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1371 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:32.516542 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a5f15040-133e-4911-abb8-6be01a975e8c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:32.517785 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-a5f15040-133e-4911-abb8-6be01a975e8c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:32.549960 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a5f15040-133e-4911-abb8-6be01a975e8c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:32.551166 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a5f15040-133e-4911-abb8-6be01a975e8c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:32.554910 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a5f15040-133e-4911-abb8-6be01a975e8c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:32.556845 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a5f15040-133e-4911-abb8-6be01a975e8c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:32.788550 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-6d30d045-8676-49c0-865a-459642386822 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:32.789855 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-6d30d045-8676-49c0-865a-459642386822 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:32.804741 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6d30d045-8676-49c0-865a-459642386822 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:32.807535 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6d30d045-8676-49c0-865a-459642386822 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:32.809904 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6d30d045-8676-49c0-865a-459642386822 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:32.810540 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6d30d045-8676-49c0-865a-459642386822 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:32.870020 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-6d30d045-8676-49c0-865a-459642386822 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2/ips" status: 200 len: 145 microversion: 2.1 time: 0.085914 May 12 11:47:32.871216 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 198/407] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 12 11:47:32 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2/ips => generated 145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:47:32.999345 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-6bb1c9a4-d542-48d5-9dc8-0b52ca3919bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:33.000362 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-6bb1c9a4-d542-48d5-9dc8-0b52ca3919bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:33.018262 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6bb1c9a4-d542-48d5-9dc8-0b52ca3919bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:33.018974 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6bb1c9a4-d542-48d5-9dc8-0b52ca3919bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:33.019931 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6bb1c9a4-d542-48d5-9dc8-0b52ca3919bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:33.020511 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6bb1c9a4-d542-48d5-9dc8-0b52ca3919bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:33.330578 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-6bb1c9a4-d542-48d5-9dc8-0b52ca3919bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:33.341276 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-6bb1c9a4-d542-48d5-9dc8-0b52ca3919bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1371 microversion: 2.1 time: 0.346892 May 12 11:47:33.347351 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 199/408] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:32 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1371 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:33.444522 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-a5f15040-133e-4911-abb8-6be01a975e8c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:33.477408 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-a5f15040-133e-4911-abb8-6be01a975e8c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:33.490374 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-a5f15040-133e-4911-abb8-6be01a975e8c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:33.492193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-a5f15040-133e-4911-abb8-6be01a975e8c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1738 microversion: 2.20 time: 0.997666 May 12 11:47:33.508316 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 210/409] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:32 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1738 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:34.364639 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-b314b6dd-088e-4d2d-9ad0-d7653a68b48c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:34.365333 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-b314b6dd-088e-4d2d-9ad0-d7653a68b48c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:34.378400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b314b6dd-088e-4d2d-9ad0-d7653a68b48c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:34.378891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b314b6dd-088e-4d2d-9ad0-d7653a68b48c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:34.379554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b314b6dd-088e-4d2d-9ad0-d7653a68b48c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:34.379993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b314b6dd-088e-4d2d-9ad0-d7653a68b48c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:34.515746 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a0c19fbb-86fa-4153-95bb-38e0c3a12e38 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:34.517100 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-a0c19fbb-86fa-4153-95bb-38e0c3a12e38 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:34.531992 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a0c19fbb-86fa-4153-95bb-38e0c3a12e38 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:34.535480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a0c19fbb-86fa-4153-95bb-38e0c3a12e38 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:34.536875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a0c19fbb-86fa-4153-95bb-38e0c3a12e38 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:34.538229 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a0c19fbb-86fa-4153-95bb-38e0c3a12e38 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:34.629523 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b314b6dd-088e-4d2d-9ad0-d7653a68b48c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:34.643485 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-b314b6dd-088e-4d2d-9ad0-d7653a68b48c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1371 microversion: 2.1 time: 0.279191 May 12 11:47:34.644461 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 200/410] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:34 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1371 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:34.923152 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-a0c19fbb-86fa-4153-95bb-38e0c3a12e38 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:34.936854 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-a0c19fbb-86fa-4153-95bb-38e0c3a12e38 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:34.941128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-a0c19fbb-86fa-4153-95bb-38e0c3a12e38 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:34.947198 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-a0c19fbb-86fa-4153-95bb-38e0c3a12e38 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1738 microversion: 2.20 time: 0.435110 May 12 11:47:34.974268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 211/411] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:34 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1738 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:35.592249 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-a9a2a1ef-8ca5-4d84-8a6a-9aa99fb3f34c req-e873c070-b4cb-4f3b-b2b9-0b90e1afea92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f609a10d-385a-4eb7-92b3-cfd766e53d22", "name": "network-vif-plugged", "status": "completed", "tag": "2eb78bc7-7875-449d-a6e9-a6f8eebe488c"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:47:35.603064 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-a9a2a1ef-8ca5-4d84-8a6a-9aa99fb3f34c req-e873c070-b4cb-4f3b-b2b9-0b90e1afea92 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:35.603913 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-a9a2a1ef-8ca5-4d84-8a6a-9aa99fb3f34c req-e873c070-b4cb-4f3b-b2b9-0b90e1afea92 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:35.618722 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-a9a2a1ef-8ca5-4d84-8a6a-9aa99fb3f34c req-e873c070-b4cb-4f3b-b2b9-0b90e1afea92 service nova] Creating event network-vif-plugged:2eb78bc7-7875-449d-a6e9-a6f8eebe488c for instance f609a10d-385a-4eb7-92b3-cfd766e53d22 on hv-cinder-80473 May 12 11:47:35.624349 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-a9a2a1ef-8ca5-4d84-8a6a-9aa99fb3f34c req-e873c070-b4cb-4f3b-b2b9-0b90e1afea92 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036977 May 12 11:47:35.627230 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 201/412] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:47:35.660364 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a72f9793-6b16-47fe-9d15-e4971ce3fa83 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:35.662043 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-a72f9793-6b16-47fe-9d15-e4971ce3fa83 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:35.674511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a72f9793-6b16-47fe-9d15-e4971ce3fa83 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:35.675499 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a72f9793-6b16-47fe-9d15-e4971ce3fa83 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:35.679014 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a72f9793-6b16-47fe-9d15-e4971ce3fa83 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:35.679762 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a72f9793-6b16-47fe-9d15-e4971ce3fa83 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:35.977762 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-dee7b638-2aec-45b0-b809-042be255a76b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:35.979180 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-dee7b638-2aec-45b0-b809-042be255a76b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:35.993845 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-dee7b638-2aec-45b0-b809-042be255a76b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:35.995394 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-dee7b638-2aec-45b0-b809-042be255a76b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:35.998295 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-dee7b638-2aec-45b0-b809-042be255a76b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:35.999547 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-dee7b638-2aec-45b0-b809-042be255a76b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:36.012252 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-a72f9793-6b16-47fe-9d15-e4971ce3fa83 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:36.026574 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-a72f9793-6b16-47fe-9d15-e4971ce3fa83 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1371 microversion: 2.1 time: 0.369857 May 12 11:47:36.027455 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 212/413] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:35 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1371 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:36.334407 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-dee7b638-2aec-45b0-b809-042be255a76b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:36.342764 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-dee7b638-2aec-45b0-b809-042be255a76b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:36.350694 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-dee7b638-2aec-45b0-b809-042be255a76b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:36.358947 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-dee7b638-2aec-45b0-b809-042be255a76b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1738 microversion: 2.20 time: 0.381086 May 12 11:47:36.361076 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 202/414] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:35 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1738 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:36.410172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-1cd542e5-bc3e-4f32-9b4e-52e1726844e6 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98129c23-04ca-4621-8558-bd0bcae0259f"}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:47:36.411861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-1cd542e5-bc3e-4f32-9b4e-52e1726844e6 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:36.450768 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1cd542e5-bc3e-4f32-9b4e-52e1726844e6 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:36.451664 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1cd542e5-bc3e-4f32-9b4e-52e1726844e6 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:36.452521 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1cd542e5-bc3e-4f32-9b4e-52e1726844e6 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:36.452969 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1cd542e5-bc3e-4f32-9b4e-52e1726844e6 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:37.044733 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-d2d127d0-4efe-4e16-96f4-3f46a15e70c6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:37.045337 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d2d127d0-4efe-4e16-96f4-3f46a15e70c6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:37.058725 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d2d127d0-4efe-4e16-96f4-3f46a15e70c6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:37.063819 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d2d127d0-4efe-4e16-96f4-3f46a15e70c6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:37.064667 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d2d127d0-4efe-4e16-96f4-3f46a15e70c6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:37.065111 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d2d127d0-4efe-4e16-96f4-3f46a15e70c6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:37.218755 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-d2d127d0-4efe-4e16-96f4-3f46a15e70c6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:37.228885 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-d2d127d0-4efe-4e16-96f4-3f46a15e70c6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1371 microversion: 2.1 time: 0.187981 May 12 11:47:37.229458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 203/415] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:37 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:37.380860 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-d0ced8dd-4f0a-4ff0-80da-715e60c6c9d4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:37.381776 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d0ced8dd-4f0a-4ff0-80da-715e60c6c9d4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:37.388916 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d0ced8dd-4f0a-4ff0-80da-715e60c6c9d4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:37.389614 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d0ced8dd-4f0a-4ff0-80da-715e60c6c9d4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:37.390586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d0ced8dd-4f0a-4ff0-80da-715e60c6c9d4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:37.391174 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d0ced8dd-4f0a-4ff0-80da-715e60c6c9d4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:37.402706 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-1cd542e5-bc3e-4f32-9b4e-52e1726844e6 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "POST /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.996928 May 12 11:47:37.412488 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 213/416] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 12 11:47:36 2022] POST /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2/os-volume_attachments => generated 194 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:47:37.553545 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-d0ced8dd-4f0a-4ff0-80da-715e60c6c9d4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:37.562668 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-d0ced8dd-4f0a-4ff0-80da-715e60c6c9d4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:37.564448 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-d0ced8dd-4f0a-4ff0-80da-715e60c6c9d4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:37.565866 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-d0ced8dd-4f0a-4ff0-80da-715e60c6c9d4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1738 microversion: 2.20 time: 0.190401 May 12 11:47:37.566581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 204/417] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:37 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:38.247574 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-2d9ef3e0-4732-4f08-b8b9-9db086b3754d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:38.250877 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-2d9ef3e0-4732-4f08-b8b9-9db086b3754d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:38.265281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2d9ef3e0-4732-4f08-b8b9-9db086b3754d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:38.265844 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2d9ef3e0-4732-4f08-b8b9-9db086b3754d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:38.268489 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2d9ef3e0-4732-4f08-b8b9-9db086b3754d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:38.268489 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2d9ef3e0-4732-4f08-b8b9-9db086b3754d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:38.414040 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-2d9ef3e0-4732-4f08-b8b9-9db086b3754d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:38.421532 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-2d9ef3e0-4732-4f08-b8b9-9db086b3754d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1564 microversion: 2.1 time: 0.179204 May 12 11:47:38.422136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 214/418] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:38 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1564 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:38.442319 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-4717cfd7-b8f5-4802-be28-5741f08dd18f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:38.443419 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-4717cfd7-b8f5-4802-be28-5741f08dd18f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:38.460956 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4717cfd7-b8f5-4802-be28-5741f08dd18f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:38.461694 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4717cfd7-b8f5-4802-be28-5741f08dd18f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:38.462493 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4717cfd7-b8f5-4802-be28-5741f08dd18f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:38.462969 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4717cfd7-b8f5-4802-be28-5741f08dd18f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:38.575866 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-4717cfd7-b8f5-4802-be28-5741f08dd18f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.138722 May 12 11:47:38.577190 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 205/419] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 12 11:47:38 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:47:38.585115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b55541a7-e84e-428e-ad0b-2af6c0b7ed7d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:38.586151 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-b55541a7-e84e-428e-ad0b-2af6c0b7ed7d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:38.596923 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b55541a7-e84e-428e-ad0b-2af6c0b7ed7d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:38.597324 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b55541a7-e84e-428e-ad0b-2af6c0b7ed7d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:38.598153 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b55541a7-e84e-428e-ad0b-2af6c0b7ed7d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:38.598759 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b55541a7-e84e-428e-ad0b-2af6c0b7ed7d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:39.036963 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b55541a7-e84e-428e-ad0b-2af6c0b7ed7d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:39.062108 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b55541a7-e84e-428e-ad0b-2af6c0b7ed7d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:39.063933 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b55541a7-e84e-428e-ad0b-2af6c0b7ed7d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:39.065158 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-b55541a7-e84e-428e-ad0b-2af6c0b7ed7d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1720 microversion: 2.20 time: 0.484565 May 12 11:47:39.076244 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 215/420] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:38 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1720 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:40.087213 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-0147900c-b717-4216-b3ce-a3c321ebc203 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:40.088036 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-0147900c-b717-4216-b3ce-a3c321ebc203 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:40.095971 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0147900c-b717-4216-b3ce-a3c321ebc203 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:40.096865 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0147900c-b717-4216-b3ce-a3c321ebc203 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:40.097879 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0147900c-b717-4216-b3ce-a3c321ebc203 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:40.098469 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0147900c-b717-4216-b3ce-a3c321ebc203 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:40.204832 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-6f897e2d-bf1b-4769-9c5e-21a0ec0b0479 req-c10a2c6a-9807-4d44-b4d4-f30002b80214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f609a10d-385a-4eb7-92b3-cfd766e53d22", "tag": "2eb78bc7-7875-449d-a6e9-a6f8eebe488c"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:47:40.220559 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-6f897e2d-bf1b-4769-9c5e-21a0ec0b0479 req-c10a2c6a-9807-4d44-b4d4-f30002b80214 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:40.221030 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-6f897e2d-bf1b-4769-9c5e-21a0ec0b0479 req-c10a2c6a-9807-4d44-b4d4-f30002b80214 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:40.252322 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-6f897e2d-bf1b-4769-9c5e-21a0ec0b0479 req-c10a2c6a-9807-4d44-b4d4-f30002b80214 service nova] Creating event network-changed:2eb78bc7-7875-449d-a6e9-a6f8eebe488c for instance f609a10d-385a-4eb7-92b3-cfd766e53d22 on hv-cinder-80473 May 12 11:47:40.266581 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-6f897e2d-bf1b-4769-9c5e-21a0ec0b0479 req-c10a2c6a-9807-4d44-b4d4-f30002b80214 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065393 May 12 11:47:40.271774 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 216/421] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:47:40.585273 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-0147900c-b717-4216-b3ce-a3c321ebc203 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:40.594712 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-0147900c-b717-4216-b3ce-a3c321ebc203 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:40.597586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-0147900c-b717-4216-b3ce-a3c321ebc203 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:40.598796 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-0147900c-b717-4216-b3ce-a3c321ebc203 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1720 microversion: 2.20 time: 0.518696 May 12 11:47:40.609734 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 206/422] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:40 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1720 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:41.271902 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-a2154a82-96b9-4f24-ac5e-59a3b0c4fb38 req-4d11928c-8479-4053-9b84-efc2c3c68b9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5cd2aad-2374-4ded-8b72-2e54fbbad916", "name": "network-vif-unplugged", "status": "completed", "tag": "d3632d97-f0ea-41b4-9003-a50ffebf91df"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:47:41.289991 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-a2154a82-96b9-4f24-ac5e-59a3b0c4fb38 req-4d11928c-8479-4053-9b84-efc2c3c68b9a service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:41.290449 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-a2154a82-96b9-4f24-ac5e-59a3b0c4fb38 req-4d11928c-8479-4053-9b84-efc2c3c68b9a service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:41.326644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-a2154a82-96b9-4f24-ac5e-59a3b0c4fb38 req-4d11928c-8479-4053-9b84-efc2c3c68b9a service nova] Creating event network-vif-unplugged:d3632d97-f0ea-41b4-9003-a50ffebf91df for instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 on hv-cinder-80473 May 12 11:47:41.334601 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-a2154a82-96b9-4f24-ac5e-59a3b0c4fb38 req-4d11928c-8479-4053-9b84-efc2c3c68b9a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066945 May 12 11:47:41.335474 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 217/423] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:47:41.617578 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-67eb180f-9418-4923-a3ba-48bdfe020a2f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:41.619506 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-67eb180f-9418-4923-a3ba-48bdfe020a2f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:41.627300 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-67eb180f-9418-4923-a3ba-48bdfe020a2f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:41.627870 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-67eb180f-9418-4923-a3ba-48bdfe020a2f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:41.634303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-67eb180f-9418-4923-a3ba-48bdfe020a2f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:41.635074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-67eb180f-9418-4923-a3ba-48bdfe020a2f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:41.774256 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-67eb180f-9418-4923-a3ba-48bdfe020a2f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:41.782509 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-67eb180f-9418-4923-a3ba-48bdfe020a2f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:41.784028 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-67eb180f-9418-4923-a3ba-48bdfe020a2f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:41.785213 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-67eb180f-9418-4923-a3ba-48bdfe020a2f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1720 microversion: 2.20 time: 0.172325 May 12 11:47:41.785791 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 207/424] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:41 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:47:42.805128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-8ceb32f4-818d-4c05-b510-62183139b55e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:42.807227 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-8ceb32f4-818d-4c05-b510-62183139b55e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:42.814656 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8ceb32f4-818d-4c05-b510-62183139b55e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:42.815514 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8ceb32f4-818d-4c05-b510-62183139b55e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:42.816952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8ceb32f4-818d-4c05-b510-62183139b55e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:42.817585 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8ceb32f4-818d-4c05-b510-62183139b55e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:43.117305 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8ceb32f4-818d-4c05-b510-62183139b55e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:43.129144 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8ceb32f4-818d-4c05-b510-62183139b55e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:43.131122 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8ceb32f4-818d-4c05-b510-62183139b55e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:43.133043 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-8ceb32f4-818d-4c05-b510-62183139b55e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1663 microversion: 2.20 time: 0.333044 May 12 11:47:43.134524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 218/425] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:42 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1663 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:43.152911 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-c4de8e06-603a-4717-9c95-41ae7e9804cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6cd26e9d-5e55-48fb-b565-9746c7066b18"}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:47:43.154418 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-c4de8e06-603a-4717-9c95-41ae7e9804cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:43.162576 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c4de8e06-603a-4717-9c95-41ae7e9804cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:43.163255 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c4de8e06-603a-4717-9c95-41ae7e9804cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:43.164394 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c4de8e06-603a-4717-9c95-41ae7e9804cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:43.165016 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c4de8e06-603a-4717-9c95-41ae7e9804cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:43.521463 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-c4de8e06-603a-4717-9c95-41ae7e9804cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "POST /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.374298 May 12 11:47:43.522303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 208/426] 10.222.0.58 () {62 vars in 1363 bytes} [Thu May 12 11:47:43 2022] POST /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916/os-volume_attachments => generated 188 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 11:47:43.651580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-e635ad0c-280d-4d1d-9736-9a5afafcdf61 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:47:43.652452 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-e635ad0c-280d-4d1d-9736-9a5afafcdf61 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:43.660048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e635ad0c-280d-4d1d-9736-9a5afafcdf61 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:43.660580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e635ad0c-280d-4d1d-9736-9a5afafcdf61 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:43.661424 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e635ad0c-280d-4d1d-9736-9a5afafcdf61 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:43.662055 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e635ad0c-280d-4d1d-9736-9a5afafcdf61 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:43.764780 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-e635ad0c-280d-4d1d-9736-9a5afafcdf61 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "POST /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916/action" status: 202 len: 0 microversion: 2.20 time: 0.117777 May 12 11:47:43.769392 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 219/427] 10.222.0.58 () {62 vars in 1318 bytes} [Thu May 12 11:47:43 2022] POST /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 11:47:43.775057 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-126c99df-9bcc-4440-850e-69e2f7fddec4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:43.776404 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-126c99df-9bcc-4440-850e-69e2f7fddec4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:43.790545 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-126c99df-9bcc-4440-850e-69e2f7fddec4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:43.793815 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-126c99df-9bcc-4440-850e-69e2f7fddec4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:43.794737 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-126c99df-9bcc-4440-850e-69e2f7fddec4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:43.795191 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-126c99df-9bcc-4440-850e-69e2f7fddec4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:43.976233 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-126c99df-9bcc-4440-850e-69e2f7fddec4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:43.985646 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-126c99df-9bcc-4440-850e-69e2f7fddec4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:43.987579 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-126c99df-9bcc-4440-850e-69e2f7fddec4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:43.988770 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-126c99df-9bcc-4440-850e-69e2f7fddec4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1749 microversion: 2.20 time: 0.217910 May 12 11:47:43.989691 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 209/428] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:43 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1749 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:45.008512 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-2bd4009a-8dd6-4ddc-b236-a43a0950ceb4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:45.009263 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-2bd4009a-8dd6-4ddc-b236-a43a0950ceb4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:45.018420 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2bd4009a-8dd6-4ddc-b236-a43a0950ceb4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:45.019047 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2bd4009a-8dd6-4ddc-b236-a43a0950ceb4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:45.020166 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2bd4009a-8dd6-4ddc-b236-a43a0950ceb4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:45.020945 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2bd4009a-8dd6-4ddc-b236-a43a0950ceb4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:45.197280 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-2bd4009a-8dd6-4ddc-b236-a43a0950ceb4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:45.207892 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-2bd4009a-8dd6-4ddc-b236-a43a0950ceb4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:45.209644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-2bd4009a-8dd6-4ddc-b236-a43a0950ceb4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:45.211085 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-2bd4009a-8dd6-4ddc-b236-a43a0950ceb4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1749 microversion: 2.20 time: 0.207101 May 12 11:47:45.212246 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 220/429] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:45 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1749 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:46.189468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-042596c7-dad7-4b25-b271-220dc6674234 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:47:46.197441 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-042596c7-dad7-4b25-b271-220dc6674234 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:46.197931 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-042596c7-dad7-4b25-b271-220dc6674234 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:46.231455 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-c2579052-d747-4b93-9fbe-ba4dd4d646cc tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:46.232053 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-c2579052-d747-4b93-9fbe-ba4dd4d646cc tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:46.238560 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c2579052-d747-4b93-9fbe-ba4dd4d646cc tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:46.239248 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c2579052-d747-4b93-9fbe-ba4dd4d646cc tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:46.240217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c2579052-d747-4b93-9fbe-ba4dd4d646cc tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:46.240825 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c2579052-d747-4b93-9fbe-ba4dd4d646cc tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:46.274193 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-042596c7-dad7-4b25-b271-220dc6674234 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Going to try to stop instance {{(pid=123507) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 12 11:47:46.324453 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-042596c7-dad7-4b25-b271-220dc6674234 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "POST /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2/action" status: 202 len: 0 microversion: 2.1 time: 0.138595 May 12 11:47:46.324992 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 210/430] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 12 11:47:46 2022] POST /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 11:47:46.338521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-806a0025-2572-473b-8748-20711e26080c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:46.339230 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-806a0025-2572-473b-8748-20711e26080c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:46.345376 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-806a0025-2572-473b-8748-20711e26080c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:46.345861 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-806a0025-2572-473b-8748-20711e26080c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:46.346648 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-806a0025-2572-473b-8748-20711e26080c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:46.347228 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-806a0025-2572-473b-8748-20711e26080c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:46.393682 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c2579052-d747-4b93-9fbe-ba4dd4d646cc tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:46.402224 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c2579052-d747-4b93-9fbe-ba4dd4d646cc tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:46.403970 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c2579052-d747-4b93-9fbe-ba4dd4d646cc tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:46.405320 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-c2579052-d747-4b93-9fbe-ba4dd4d646cc tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1751 microversion: 2.20 time: 0.178535 May 12 11:47:46.406073 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 221/431] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:46 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:47:46.498238 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-806a0025-2572-473b-8748-20711e26080c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:46.511608 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-806a0025-2572-473b-8748-20711e26080c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1722 microversion: 2.1 time: 0.182041 May 12 11:47:46.513159 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 211/432] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:46 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:47.423760 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-23b99bef-8d09-4208-be97-01022a3fb413 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:47.424280 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-23b99bef-8d09-4208-be97-01022a3fb413 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:47.430886 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-23b99bef-8d09-4208-be97-01022a3fb413 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:47.431867 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-23b99bef-8d09-4208-be97-01022a3fb413 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:47.432871 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-23b99bef-8d09-4208-be97-01022a3fb413 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:47.433473 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-23b99bef-8d09-4208-be97-01022a3fb413 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:47.535630 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-4bb5a182-f59f-4449-81ed-b69ca7c47132 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:47.541245 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-4bb5a182-f59f-4449-81ed-b69ca7c47132 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:47.558584 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4bb5a182-f59f-4449-81ed-b69ca7c47132 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:47.559414 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4bb5a182-f59f-4449-81ed-b69ca7c47132 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:47.560439 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4bb5a182-f59f-4449-81ed-b69ca7c47132 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:47.561583 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4bb5a182-f59f-4449-81ed-b69ca7c47132 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:47.669938 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-23b99bef-8d09-4208-be97-01022a3fb413 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:47.682113 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-23b99bef-8d09-4208-be97-01022a3fb413 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:47.686230 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-23b99bef-8d09-4208-be97-01022a3fb413 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:47.687654 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-23b99bef-8d09-4208-be97-01022a3fb413 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.267901 May 12 11:47:47.688334 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 222/433] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:47 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:47.745395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-4bb5a182-f59f-4449-81ed-b69ca7c47132 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:47.756433 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-4bb5a182-f59f-4449-81ed-b69ca7c47132 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1722 microversion: 2.1 time: 0.229683 May 12 11:47:47.757669 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 212/434] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:47 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:48.708728 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-9f15bab1-a231-4d7f-9a27-a04f8d29392f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:48.709511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-9f15bab1-a231-4d7f-9a27-a04f8d29392f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:48.716524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9f15bab1-a231-4d7f-9a27-a04f8d29392f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:48.717334 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9f15bab1-a231-4d7f-9a27-a04f8d29392f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:48.718357 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9f15bab1-a231-4d7f-9a27-a04f8d29392f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:48.718800 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9f15bab1-a231-4d7f-9a27-a04f8d29392f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:48.782248 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-a92efeff-1aea-41b0-ae10-8d765f611570 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:48.782824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-a92efeff-1aea-41b0-ae10-8d765f611570 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:48.805937 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a92efeff-1aea-41b0-ae10-8d765f611570 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:48.806431 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a92efeff-1aea-41b0-ae10-8d765f611570 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:48.807223 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a92efeff-1aea-41b0-ae10-8d765f611570 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:48.807661 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a92efeff-1aea-41b0-ae10-8d765f611570 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:48.936484 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-9f15bab1-a231-4d7f-9a27-a04f8d29392f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:48.948772 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-9f15bab1-a231-4d7f-9a27-a04f8d29392f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:48.950308 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-9f15bab1-a231-4d7f-9a27-a04f8d29392f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:48.951762 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-9f15bab1-a231-4d7f-9a27-a04f8d29392f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.247765 May 12 11:47:48.952327 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 223/435] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:48 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:48.973779 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-a92efeff-1aea-41b0-ae10-8d765f611570 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:48.983227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-a92efeff-1aea-41b0-ae10-8d765f611570 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1722 microversion: 2.1 time: 0.210252 May 12 11:47:48.984010 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 213/436] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:48 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:49.970716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-4929379c-70b6-4a80-af01-ac806fd2dd10 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:49.971319 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-4929379c-70b6-4a80-af01-ac806fd2dd10 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:49.978600 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4929379c-70b6-4a80-af01-ac806fd2dd10 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:49.979052 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4929379c-70b6-4a80-af01-ac806fd2dd10 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:49.979820 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4929379c-70b6-4a80-af01-ac806fd2dd10 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:49.980255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4929379c-70b6-4a80-af01-ac806fd2dd10 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:50.002378 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-1f24342a-ecd7-44c4-a54e-a0608960f4ce tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:50.003000 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-1f24342a-ecd7-44c4-a54e-a0608960f4ce tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:50.011393 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1f24342a-ecd7-44c4-a54e-a0608960f4ce tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:50.011851 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1f24342a-ecd7-44c4-a54e-a0608960f4ce tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:50.013595 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1f24342a-ecd7-44c4-a54e-a0608960f4ce tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:50.014588 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1f24342a-ecd7-44c4-a54e-a0608960f4ce tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:50.135131 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-4929379c-70b6-4a80-af01-ac806fd2dd10 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:50.144729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-4929379c-70b6-4a80-af01-ac806fd2dd10 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:50.146510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-4929379c-70b6-4a80-af01-ac806fd2dd10 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:50.147685 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-4929379c-70b6-4a80-af01-ac806fd2dd10 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.180773 May 12 11:47:50.148247 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 224/437] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:49 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:47:50.197216 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-1f24342a-ecd7-44c4-a54e-a0608960f4ce tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:50.205961 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-1f24342a-ecd7-44c4-a54e-a0608960f4ce tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1722 microversion: 2.1 time: 0.207556 May 12 11:47:50.206543 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 214/438] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:49 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:51.181859 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-8c1948cd-d5fa-46be-90aa-0a0d1c17590c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:51.183181 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-8c1948cd-d5fa-46be-90aa-0a0d1c17590c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:51.192125 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8c1948cd-d5fa-46be-90aa-0a0d1c17590c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:51.192892 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8c1948cd-d5fa-46be-90aa-0a0d1c17590c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:51.193938 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8c1948cd-d5fa-46be-90aa-0a0d1c17590c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:51.197907 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8c1948cd-d5fa-46be-90aa-0a0d1c17590c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:51.225372 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-d5076fcd-9a11-487b-ac43-c047c6ca21bb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:51.226559 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d5076fcd-9a11-487b-ac43-c047c6ca21bb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:51.234756 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d5076fcd-9a11-487b-ac43-c047c6ca21bb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:51.235411 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d5076fcd-9a11-487b-ac43-c047c6ca21bb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:51.236392 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d5076fcd-9a11-487b-ac43-c047c6ca21bb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:51.237020 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d5076fcd-9a11-487b-ac43-c047c6ca21bb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:51.382067 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8c1948cd-d5fa-46be-90aa-0a0d1c17590c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:51.398449 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8c1948cd-d5fa-46be-90aa-0a0d1c17590c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:51.398912 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-d5076fcd-9a11-487b-ac43-c047c6ca21bb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:51.406784 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8c1948cd-d5fa-46be-90aa-0a0d1c17590c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:51.407062 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-d5076fcd-9a11-487b-ac43-c047c6ca21bb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1722 microversion: 2.1 time: 0.186963 May 12 11:47:51.408369 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 215/439] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:51 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:47:51.410203 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-8c1948cd-d5fa-46be-90aa-0a0d1c17590c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.243628 May 12 11:47:51.410773 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 225/440] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:51 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:52.425657 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-2e83700f-982a-466b-9c7d-3001cb70969f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:52.426454 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-2e83700f-982a-466b-9c7d-3001cb70969f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:52.428468 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-93b0ad39-68aa-42e9-9800-a7b19ea056cb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:52.430294 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-93b0ad39-68aa-42e9-9800-a7b19ea056cb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:52.434865 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2e83700f-982a-466b-9c7d-3001cb70969f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:52.435431 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2e83700f-982a-466b-9c7d-3001cb70969f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:52.436457 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2e83700f-982a-466b-9c7d-3001cb70969f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:52.437125 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2e83700f-982a-466b-9c7d-3001cb70969f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:52.437658 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-93b0ad39-68aa-42e9-9800-a7b19ea056cb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:52.438294 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-93b0ad39-68aa-42e9-9800-a7b19ea056cb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:52.440605 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-93b0ad39-68aa-42e9-9800-a7b19ea056cb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:52.443581 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-93b0ad39-68aa-42e9-9800-a7b19ea056cb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:52.595373 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-2e83700f-982a-466b-9c7d-3001cb70969f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:52.597726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-93b0ad39-68aa-42e9-9800-a7b19ea056cb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:52.605764 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-2e83700f-982a-466b-9c7d-3001cb70969f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1722 microversion: 2.1 time: 0.184612 May 12 11:47:52.608482 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-93b0ad39-68aa-42e9-9800-a7b19ea056cb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:52.610539 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-93b0ad39-68aa-42e9-9800-a7b19ea056cb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:52.612190 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-93b0ad39-68aa-42e9-9800-a7b19ea056cb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.187397 May 12 11:47:52.616275 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 216/441] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:52 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:52.618178 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 226/442] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:52 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:47:53.625425 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-87380283-3570-46cf-869c-4faa3f61b599 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:53.625425 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-87380283-3570-46cf-869c-4faa3f61b599 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:53.631549 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-87380283-3570-46cf-869c-4faa3f61b599 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:53.631722 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-8476531b-a947-4cc3-af43-2a7801c03dbd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:53.632157 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-87380283-3570-46cf-869c-4faa3f61b599 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:53.633027 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-8476531b-a947-4cc3-af43-2a7801c03dbd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:53.633235 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-87380283-3570-46cf-869c-4faa3f61b599 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:53.633332 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-87380283-3570-46cf-869c-4faa3f61b599 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:53.639682 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8476531b-a947-4cc3-af43-2a7801c03dbd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:53.642257 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8476531b-a947-4cc3-af43-2a7801c03dbd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:53.643309 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8476531b-a947-4cc3-af43-2a7801c03dbd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:53.643764 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8476531b-a947-4cc3-af43-2a7801c03dbd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:53.823826 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-87380283-3570-46cf-869c-4faa3f61b599 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:53.834730 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-87380283-3570-46cf-869c-4faa3f61b599 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1722 microversion: 2.1 time: 0.214445 May 12 11:47:53.835316 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 217/443] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:53 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:53.844997 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8476531b-a947-4cc3-af43-2a7801c03dbd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:53.851857 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8476531b-a947-4cc3-af43-2a7801c03dbd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:53.853414 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8476531b-a947-4cc3-af43-2a7801c03dbd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:53.854628 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-8476531b-a947-4cc3-af43-2a7801c03dbd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.227846 May 12 11:47:53.855194 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 227/444] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:53 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:47:54.852294 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-8f24c90f-8471-45e2-9770-f0311a43b0eb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:54.853689 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-8f24c90f-8471-45e2-9770-f0311a43b0eb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:54.862559 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8f24c90f-8471-45e2-9770-f0311a43b0eb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:54.863253 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8f24c90f-8471-45e2-9770-f0311a43b0eb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:54.864206 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8f24c90f-8471-45e2-9770-f0311a43b0eb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:54.864656 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8f24c90f-8471-45e2-9770-f0311a43b0eb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:54.872782 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-17e1e82d-1c61-4c27-8177-d225280ef562 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:54.874017 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-17e1e82d-1c61-4c27-8177-d225280ef562 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:54.882853 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-17e1e82d-1c61-4c27-8177-d225280ef562 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:54.885090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-17e1e82d-1c61-4c27-8177-d225280ef562 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:54.886085 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-17e1e82d-1c61-4c27-8177-d225280ef562 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:54.887864 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-17e1e82d-1c61-4c27-8177-d225280ef562 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:55.049416 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-8f24c90f-8471-45e2-9770-f0311a43b0eb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:55.058203 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-8f24c90f-8471-45e2-9770-f0311a43b0eb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1722 microversion: 2.1 time: 0.209566 May 12 11:47:55.059278 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 218/445] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:54 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:55.085428 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-17e1e82d-1c61-4c27-8177-d225280ef562 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:55.096797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-17e1e82d-1c61-4c27-8177-d225280ef562 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:55.098418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-17e1e82d-1c61-4c27-8177-d225280ef562 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:55.100090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-17e1e82d-1c61-4c27-8177-d225280ef562 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.230993 May 12 11:47:55.110069 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 228/446] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:54 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:56.075476 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-8346c0eb-6c4f-4e43-b0a0-5f5e60d414c8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:56.076338 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-8346c0eb-6c4f-4e43-b0a0-5f5e60d414c8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:56.082621 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8346c0eb-6c4f-4e43-b0a0-5f5e60d414c8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:56.083072 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8346c0eb-6c4f-4e43-b0a0-5f5e60d414c8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:56.083835 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8346c0eb-6c4f-4e43-b0a0-5f5e60d414c8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:56.084274 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8346c0eb-6c4f-4e43-b0a0-5f5e60d414c8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:56.119155 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ab8f2ef7-6263-41b3-9765-8a9b01165b26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:56.120506 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-ab8f2ef7-6263-41b3-9765-8a9b01165b26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:56.132182 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ab8f2ef7-6263-41b3-9765-8a9b01165b26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:56.133017 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ab8f2ef7-6263-41b3-9765-8a9b01165b26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:56.134077 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ab8f2ef7-6263-41b3-9765-8a9b01165b26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:56.134983 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ab8f2ef7-6263-41b3-9765-8a9b01165b26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:56.230109 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-8346c0eb-6c4f-4e43-b0a0-5f5e60d414c8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:56.239622 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-8346c0eb-6c4f-4e43-b0a0-5f5e60d414c8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1722 microversion: 2.1 time: 0.167878 May 12 11:47:56.244957 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 219/447] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:56 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:56.307297 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-ab8f2ef7-6263-41b3-9765-8a9b01165b26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:56.318307 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-ab8f2ef7-6263-41b3-9765-8a9b01165b26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:56.319989 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-ab8f2ef7-6263-41b3-9765-8a9b01165b26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:56.321681 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-ab8f2ef7-6263-41b3-9765-8a9b01165b26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.206493 May 12 11:47:56.322476 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 229/448] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:56 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:47:57.260436 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-d0a27a8c-006c-4200-8ee8-613ae72dc47c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:57.261060 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d0a27a8c-006c-4200-8ee8-613ae72dc47c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:57.267730 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d0a27a8c-006c-4200-8ee8-613ae72dc47c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:57.268425 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d0a27a8c-006c-4200-8ee8-613ae72dc47c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:57.269376 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d0a27a8c-006c-4200-8ee8-613ae72dc47c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:57.269989 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d0a27a8c-006c-4200-8ee8-613ae72dc47c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:57.340297 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-1fb40fb7-7ed7-4ae3-8742-54aa340c55ab tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:57.341094 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-1fb40fb7-7ed7-4ae3-8742-54aa340c55ab tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:57.352126 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1fb40fb7-7ed7-4ae3-8742-54aa340c55ab tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:57.354904 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1fb40fb7-7ed7-4ae3-8742-54aa340c55ab tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:57.355926 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1fb40fb7-7ed7-4ae3-8742-54aa340c55ab tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:57.357360 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1fb40fb7-7ed7-4ae3-8742-54aa340c55ab tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:57.411714 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-d0a27a8c-006c-4200-8ee8-613ae72dc47c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:57.427930 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-d0a27a8c-006c-4200-8ee8-613ae72dc47c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1722 microversion: 2.1 time: 0.171211 May 12 11:47:57.439398 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 220/449] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:57 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:57.534948 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-1fb40fb7-7ed7-4ae3-8742-54aa340c55ab tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:57.546358 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-1fb40fb7-7ed7-4ae3-8742-54aa340c55ab tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:57.548188 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-1fb40fb7-7ed7-4ae3-8742-54aa340c55ab tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:57.549357 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-1fb40fb7-7ed7-4ae3-8742-54aa340c55ab tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.213028 May 12 11:47:57.549989 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 230/450] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:57 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:47:58.447484 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-9ee263d2-7a32-46ab-9a49-58f1f1b2a492 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:58.453914 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-9ee263d2-7a32-46ab-9a49-58f1f1b2a492 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:58.467696 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9ee263d2-7a32-46ab-9a49-58f1f1b2a492 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:58.468151 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9ee263d2-7a32-46ab-9a49-58f1f1b2a492 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:58.468943 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9ee263d2-7a32-46ab-9a49-58f1f1b2a492 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:58.469382 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9ee263d2-7a32-46ab-9a49-58f1f1b2a492 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:58.568154 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-2e98a591-3e91-44f2-a8a8-83355f07a530 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:58.569375 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-2e98a591-3e91-44f2-a8a8-83355f07a530 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:58.577490 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2e98a591-3e91-44f2-a8a8-83355f07a530 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:58.577969 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2e98a591-3e91-44f2-a8a8-83355f07a530 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:58.578940 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2e98a591-3e91-44f2-a8a8-83355f07a530 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:58.579382 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2e98a591-3e91-44f2-a8a8-83355f07a530 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:58.636104 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-9ee263d2-7a32-46ab-9a49-58f1f1b2a492 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:58.644915 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-9ee263d2-7a32-46ab-9a49-58f1f1b2a492 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1722 microversion: 2.1 time: 0.201793 May 12 11:47:58.645501 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 221/451] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:58 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:58.750948 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-2e98a591-3e91-44f2-a8a8-83355f07a530 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:58.759576 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-2e98a591-3e91-44f2-a8a8-83355f07a530 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:58.761086 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-2e98a591-3e91-44f2-a8a8-83355f07a530 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:58.762287 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-2e98a591-3e91-44f2-a8a8-83355f07a530 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.198403 May 12 11:47:58.762852 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 231/452] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:58 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:47:59.661738 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-10a2bd8d-4b50-435d-81aa-7d7b6d91b457 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:59.662916 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-10a2bd8d-4b50-435d-81aa-7d7b6d91b457 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:59.670154 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-10a2bd8d-4b50-435d-81aa-7d7b6d91b457 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:59.670815 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-10a2bd8d-4b50-435d-81aa-7d7b6d91b457 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:59.671740 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-10a2bd8d-4b50-435d-81aa-7d7b6d91b457 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:59.672320 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-10a2bd8d-4b50-435d-81aa-7d7b6d91b457 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:59.780810 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b1751599-afd6-4220-8c2a-90e748b85876 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:47:59.782098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-b1751599-afd6-4220-8c2a-90e748b85876 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:47:59.792637 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b1751599-afd6-4220-8c2a-90e748b85876 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:59.793391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b1751599-afd6-4220-8c2a-90e748b85876 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:59.796568 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b1751599-afd6-4220-8c2a-90e748b85876 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:47:59.797196 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b1751599-afd6-4220-8c2a-90e748b85876 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:47:59.877588 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-10a2bd8d-4b50-435d-81aa-7d7b6d91b457 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:59.886264 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-10a2bd8d-4b50-435d-81aa-7d7b6d91b457 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1722 microversion: 2.1 time: 0.228821 May 12 11:47:59.886965 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 222/453] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:47:59 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:47:59.945829 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b1751599-afd6-4220-8c2a-90e748b85876 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:59.955205 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b1751599-afd6-4220-8c2a-90e748b85876 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:59.956703 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b1751599-afd6-4220-8c2a-90e748b85876 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:47:59.957885 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-b1751599-afd6-4220-8c2a-90e748b85876 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.181009 May 12 11:47:59.958444 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 232/454] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:47:59 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:48:00.904755 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-9b777fcd-4eb3-4c5c-9d1a-96c4fb217e8b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:00.905864 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-9b777fcd-4eb3-4c5c-9d1a-96c4fb217e8b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:00.914886 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9b777fcd-4eb3-4c5c-9d1a-96c4fb217e8b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:00.915982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9b777fcd-4eb3-4c5c-9d1a-96c4fb217e8b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:00.916763 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9b777fcd-4eb3-4c5c-9d1a-96c4fb217e8b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:00.917192 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9b777fcd-4eb3-4c5c-9d1a-96c4fb217e8b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:00.976170 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-1fc4bafd-e971-4788-bdac-876dc44828cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:00.977363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-1fc4bafd-e971-4788-bdac-876dc44828cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:00.984474 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1fc4bafd-e971-4788-bdac-876dc44828cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:00.984931 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1fc4bafd-e971-4788-bdac-876dc44828cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:00.985731 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1fc4bafd-e971-4788-bdac-876dc44828cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:00.986267 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1fc4bafd-e971-4788-bdac-876dc44828cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:01.046234 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-9b777fcd-4eb3-4c5c-9d1a-96c4fb217e8b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:01.056103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-9b777fcd-4eb3-4c5c-9d1a-96c4fb217e8b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1699 microversion: 2.1 time: 0.156200 May 12 11:48:01.057756 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 223/455] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:00 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1699 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:01.075157 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-05936c51-f1aa-41ed-97e3-db5af5e072db tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:48:01.083318 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-05936c51-f1aa-41ed-97e3-db5af5e072db tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:01.083761 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-05936c51-f1aa-41ed-97e3-db5af5e072db tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:01.113956 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-05936c51-f1aa-41ed-97e3-db5af5e072db tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Going to try to start instance {{(pid=123507) start /opt/stack/nova/nova/compute/api.py:2730}} May 12 11:48:01.122516 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-1fc4bafd-e971-4788-bdac-876dc44828cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:01.130844 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-1fc4bafd-e971-4788-bdac-876dc44828cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:01.132392 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-1fc4bafd-e971-4788-bdac-876dc44828cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:01.133557 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-1fc4bafd-e971-4788-bdac-876dc44828cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.161405 May 12 11:48:01.136018 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 233/456] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:48:00 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:48:01.162151 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-05936c51-f1aa-41ed-97e3-db5af5e072db tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "POST /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2/action" status: 202 len: 0 microversion: 2.1 time: 0.091297 May 12 11:48:01.162788 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 224/457] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 12 11:48:01 2022] POST /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:48:01.170852 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-175b0981-771d-4718-a9e8-fab6118f205f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:01.171462 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-175b0981-771d-4718-a9e8-fab6118f205f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:01.177196 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-175b0981-771d-4718-a9e8-fab6118f205f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:01.177638 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-175b0981-771d-4718-a9e8-fab6118f205f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:01.178450 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-175b0981-771d-4718-a9e8-fab6118f205f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:01.178886 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-175b0981-771d-4718-a9e8-fab6118f205f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:01.231434 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-3217bf48-b1d4-4ace-9b98-67797c0ca6fb tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2132330412", "imageRef": "576e8b7b-771b-47aa-89c6-ff04accc9bea", "flavorRef": "452", "networks": [{"uuid": "acb61e6d-7b7b-4a9a-bc49-033a539945dd"}]}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:48:01.284323 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.network.neutron [None req-3217bf48-b1d4-4ace-9b98-67797c0ca6fb tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] validate_networks() for [('acb61e6d-7b7b-4a9a-bc49-033a539945dd', None, None, None, None, None)] {{(pid=123507) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 11:48:01.310207 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-175b0981-771d-4718-a9e8-fab6118f205f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:01.317921 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-175b0981-771d-4718-a9e8-fab6118f205f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1708 microversion: 2.1 time: 0.150865 May 12 11:48:01.318719 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 234/458] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:01 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1708 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:48:01.649822 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-3217bf48-b1d4-4ace-9b98-67797c0ca6fb tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Flavor limits 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 11:48:01.650248 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-3217bf48-b1d4-4ace-9b98-67797c0ca6fb tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Image limits 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 11:48:01.650722 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-3217bf48-b1d4-4ace-9b98-67797c0ca6fb tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Flavor pref 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 11:48:01.651127 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-3217bf48-b1d4-4ace-9b98-67797c0ca6fb tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Image pref 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 11:48:01.651537 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-3217bf48-b1d4-4ace-9b98-67797c0ca6fb tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 11:48:01.659995 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3217bf48-b1d4-4ace-9b98-67797c0ca6fb tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:01.660458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3217bf48-b1d4-4ace-9b98-67797c0ca6fb tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:01.661236 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3217bf48-b1d4-4ace-9b98-67797c0ca6fb tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:01.661666 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3217bf48-b1d4-4ace-9b98-67797c0ca6fb tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:01.678128 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-3217bf48-b1d4-4ace-9b98-67797c0ca6fb tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Getting quotas for project 7a1abe690e43433daccff30391d4b260. Resources: {'ram', 'cores', 'instances'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:48:01.682529 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-3217bf48-b1d4-4ace-9b98-67797c0ca6fb tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Getting quotas for user 70abbcb3651945609f0e65237135f3e7 and project 7a1abe690e43433daccff30391d4b260. Resources: {'ram', 'cores', 'instances'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:48:01.693103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-3217bf48-b1d4-4ace-9b98-67797c0ca6fb tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Going to run 1 instances... {{(pid=123507) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 11:48:01.695489 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-3217bf48-b1d4-4ace-9b98-67797c0ca6fb tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='576e8b7b-771b-47aa-89c6-ff04accc9bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123507) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 11:48:01.744025 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-3217bf48-b1d4-4ace-9b98-67797c0ca6fb tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516258 May 12 11:48:01.745068 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 225/459] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 12 11:48:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 11:48:01.757817 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-7a67e46e-5e10-46cf-9604-08f142f5ede2 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:01.758469 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-7a67e46e-5e10-46cf-9604-08f142f5ede2 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:01.839580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-7a67e46e-5e10-46cf-9604-08f142f5ede2 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:01.846514 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-7a67e46e-5e10-46cf-9604-08f142f5ede2 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6" status: 200 len: 1219 microversion: 2.1 time: 0.092846 May 12 11:48:01.847071 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 235/460] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:01 2022] GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:02.152475 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-c377b32c-a963-414b-89a3-cd892e1cca9f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:02.153109 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-c377b32c-a963-414b-89a3-cd892e1cca9f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:02.159841 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c377b32c-a963-414b-89a3-cd892e1cca9f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:02.160284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c377b32c-a963-414b-89a3-cd892e1cca9f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:02.161041 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c377b32c-a963-414b-89a3-cd892e1cca9f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:02.161470 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c377b32c-a963-414b-89a3-cd892e1cca9f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:02.289267 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-c377b32c-a963-414b-89a3-cd892e1cca9f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:02.301094 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-c377b32c-a963-414b-89a3-cd892e1cca9f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:02.303137 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-c377b32c-a963-414b-89a3-cd892e1cca9f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:02.303768 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-c377b32c-a963-414b-89a3-cd892e1cca9f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.156150 May 12 11:48:02.304331 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 226/461] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:48:02 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:48:02.335952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-49f6729b-eb89-48f7-9f3e-20e04d70bc4b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:02.336564 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-49f6729b-eb89-48f7-9f3e-20e04d70bc4b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:02.343943 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-49f6729b-eb89-48f7-9f3e-20e04d70bc4b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:02.344393 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-49f6729b-eb89-48f7-9f3e-20e04d70bc4b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:02.345167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-49f6729b-eb89-48f7-9f3e-20e04d70bc4b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:02.345603 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-49f6729b-eb89-48f7-9f3e-20e04d70bc4b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:02.534294 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-49f6729b-eb89-48f7-9f3e-20e04d70bc4b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:02.543515 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-49f6729b-eb89-48f7-9f3e-20e04d70bc4b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1708 microversion: 2.1 time: 0.211549 May 12 11:48:02.544213 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 236/462] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:02 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1708 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:02.864144 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-f48315a4-d983-4cb5-8679-9c5d3a4b8660 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:02.864669 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-f48315a4-d983-4cb5-8679-9c5d3a4b8660 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:02.871205 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f48315a4-d983-4cb5-8679-9c5d3a4b8660 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:02.871651 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f48315a4-d983-4cb5-8679-9c5d3a4b8660 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:02.872411 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f48315a4-d983-4cb5-8679-9c5d3a4b8660 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:02.872843 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f48315a4-d983-4cb5-8679-9c5d3a4b8660 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:02.937791 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-f48315a4-d983-4cb5-8679-9c5d3a4b8660 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:02.945146 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-f48315a4-d983-4cb5-8679-9c5d3a4b8660 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6" status: 200 len: 1271 microversion: 2.1 time: 0.084916 May 12 11:48:02.945933 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 227/463] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:02 2022] GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:03.322523 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-6ec7b2a8-9095-4bd3-9874-cf7e92e2cc5f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:03.323243 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-6ec7b2a8-9095-4bd3-9874-cf7e92e2cc5f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:03.329371 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6ec7b2a8-9095-4bd3-9874-cf7e92e2cc5f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:03.329856 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6ec7b2a8-9095-4bd3-9874-cf7e92e2cc5f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:03.330630 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6ec7b2a8-9095-4bd3-9874-cf7e92e2cc5f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:03.331068 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6ec7b2a8-9095-4bd3-9874-cf7e92e2cc5f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:03.526887 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-6ec7b2a8-9095-4bd3-9874-cf7e92e2cc5f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:03.535324 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-6ec7b2a8-9095-4bd3-9874-cf7e92e2cc5f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:03.536834 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-6ec7b2a8-9095-4bd3-9874-cf7e92e2cc5f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:03.538015 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-6ec7b2a8-9095-4bd3-9874-cf7e92e2cc5f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.219451 May 12 11:48:03.538575 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 237/464] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:48:03 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:48:03.561425 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-61f25a2f-9b52-4dae-99a7-0b8c80fbbefd tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:03.562256 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-61f25a2f-9b52-4dae-99a7-0b8c80fbbefd tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:03.568917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-61f25a2f-9b52-4dae-99a7-0b8c80fbbefd tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:03.569425 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-61f25a2f-9b52-4dae-99a7-0b8c80fbbefd tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:03.570259 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-61f25a2f-9b52-4dae-99a7-0b8c80fbbefd tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:03.570699 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-61f25a2f-9b52-4dae-99a7-0b8c80fbbefd tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:03.696849 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-61f25a2f-9b52-4dae-99a7-0b8c80fbbefd tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:03.705060 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-61f25a2f-9b52-4dae-99a7-0b8c80fbbefd tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1708 microversion: 2.1 time: 0.148022 May 12 11:48:03.705777 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 228/465] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:03 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1708 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:03.963686 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-413ffaef-537c-4530-bbc6-e66efecd8e25 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:03.964539 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-413ffaef-537c-4530-bbc6-e66efecd8e25 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:03.970991 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-413ffaef-537c-4530-bbc6-e66efecd8e25 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:03.971429 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-413ffaef-537c-4530-bbc6-e66efecd8e25 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:03.972230 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-413ffaef-537c-4530-bbc6-e66efecd8e25 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:03.972683 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-413ffaef-537c-4530-bbc6-e66efecd8e25 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:04.108151 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-413ffaef-537c-4530-bbc6-e66efecd8e25 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:04.115371 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-413ffaef-537c-4530-bbc6-e66efecd8e25 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6" status: 200 len: 1319 microversion: 2.1 time: 0.156259 May 12 11:48:04.115939 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 238/466] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:03 2022] GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:04.556972 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-99387d10-4a86-4c87-bf67-ee8e9006445b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:04.557585 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-99387d10-4a86-4c87-bf67-ee8e9006445b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:04.563784 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-99387d10-4a86-4c87-bf67-ee8e9006445b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:04.564334 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-99387d10-4a86-4c87-bf67-ee8e9006445b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:04.564996 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-99387d10-4a86-4c87-bf67-ee8e9006445b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:04.565433 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-99387d10-4a86-4c87-bf67-ee8e9006445b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:04.697177 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-99387d10-4a86-4c87-bf67-ee8e9006445b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:04.706119 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-99387d10-4a86-4c87-bf67-ee8e9006445b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:04.707726 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-99387d10-4a86-4c87-bf67-ee8e9006445b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:04.708998 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-99387d10-4a86-4c87-bf67-ee8e9006445b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.156462 May 12 11:48:04.709636 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 229/467] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:48:04 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:48:04.722986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-27cf5ce1-975c-4611-afb4-bd150aa78c1c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:04.723739 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-27cf5ce1-975c-4611-afb4-bd150aa78c1c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:04.730667 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-27cf5ce1-975c-4611-afb4-bd150aa78c1c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:04.731114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-27cf5ce1-975c-4611-afb4-bd150aa78c1c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:04.731891 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-27cf5ce1-975c-4611-afb4-bd150aa78c1c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:04.732327 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-27cf5ce1-975c-4611-afb4-bd150aa78c1c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:04.939569 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-27cf5ce1-975c-4611-afb4-bd150aa78c1c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:04.947523 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-27cf5ce1-975c-4611-afb4-bd150aa78c1c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1712 microversion: 2.1 time: 0.228253 May 12 11:48:04.948028 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 239/468] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:04 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1712 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:05.110882 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-66b3ec8a-cc0a-49a9-8e7c-73d09aee90ca req-cde0aaf2-687e-4e99-9235-6703f41cac98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4394d3b-8300-4ce2-837d-65d1e01cc7c6", "tag": "7d624a29-c293-4840-b98d-df28f56aaff7"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:48:05.120847 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-66b3ec8a-cc0a-49a9-8e7c-73d09aee90ca req-cde0aaf2-687e-4e99-9235-6703f41cac98 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:05.121314 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-66b3ec8a-cc0a-49a9-8e7c-73d09aee90ca req-cde0aaf2-687e-4e99-9235-6703f41cac98 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:05.132111 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-66b3ec8a-cc0a-49a9-8e7c-73d09aee90ca req-cde0aaf2-687e-4e99-9235-6703f41cac98 service nova] Creating event network-changed:7d624a29-c293-4840-b98d-df28f56aaff7 for instance a4394d3b-8300-4ce2-837d-65d1e01cc7c6 on hv-cinder-80473 May 12 11:48:05.132328 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-0b98d962-d8a5-4e26-944f-70d152f990f7 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:05.133160 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-0b98d962-d8a5-4e26-944f-70d152f990f7 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:05.136615 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-66b3ec8a-cc0a-49a9-8e7c-73d09aee90ca req-cde0aaf2-687e-4e99-9235-6703f41cac98 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029453 May 12 11:48:05.137789 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 230/469] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:48:05.139361 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0b98d962-d8a5-4e26-944f-70d152f990f7 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:05.140111 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0b98d962-d8a5-4e26-944f-70d152f990f7 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:05.141159 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0b98d962-d8a5-4e26-944f-70d152f990f7 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:05.141631 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0b98d962-d8a5-4e26-944f-70d152f990f7 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:05.592143 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-0b98d962-d8a5-4e26-944f-70d152f990f7 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:05.599407 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-0b98d962-d8a5-4e26-944f-70d152f990f7 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6" status: 200 len: 1319 microversion: 2.1 time: 0.471102 May 12 11:48:05.599979 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 240/470] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:05 2022] GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6 => generated 1319 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:48:05.728055 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-77e9bf79-34b8-4655-a29d-b77bbd1ceda5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:05.728743 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-77e9bf79-34b8-4655-a29d-b77bbd1ceda5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:05.735021 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-77e9bf79-34b8-4655-a29d-b77bbd1ceda5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:05.735472 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-77e9bf79-34b8-4655-a29d-b77bbd1ceda5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:05.736239 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-77e9bf79-34b8-4655-a29d-b77bbd1ceda5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:05.736676 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-77e9bf79-34b8-4655-a29d-b77bbd1ceda5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:05.864215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-77e9bf79-34b8-4655-a29d-b77bbd1ceda5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:05.872817 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-77e9bf79-34b8-4655-a29d-b77bbd1ceda5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:05.874406 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-77e9bf79-34b8-4655-a29d-b77bbd1ceda5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:05.875558 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-77e9bf79-34b8-4655-a29d-b77bbd1ceda5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.152283 May 12 11:48:05.876121 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 231/471] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:48:05 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:48:06.615926 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-d109bcbf-dd12-4268-9185-7cf21d3b6fc8 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:06.616539 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d109bcbf-dd12-4268-9185-7cf21d3b6fc8 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:06.623456 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d109bcbf-dd12-4268-9185-7cf21d3b6fc8 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:06.623915 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d109bcbf-dd12-4268-9185-7cf21d3b6fc8 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:06.625279 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d109bcbf-dd12-4268-9185-7cf21d3b6fc8 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:06.625749 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d109bcbf-dd12-4268-9185-7cf21d3b6fc8 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:06.813780 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-d109bcbf-dd12-4268-9185-7cf21d3b6fc8 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:06.821029 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-d109bcbf-dd12-4268-9185-7cf21d3b6fc8 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6" status: 200 len: 1319 microversion: 2.1 time: 0.208966 May 12 11:48:06.822270 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 241/472] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:06 2022] GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:06.893751 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-a389422d-fa6e-4ce0-8633-10e6dd1c5e2b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:06.894324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-a389422d-fa6e-4ce0-8633-10e6dd1c5e2b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:06.900592 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a389422d-fa6e-4ce0-8633-10e6dd1c5e2b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:06.901036 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a389422d-fa6e-4ce0-8633-10e6dd1c5e2b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:06.901819 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a389422d-fa6e-4ce0-8633-10e6dd1c5e2b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:06.902251 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a389422d-fa6e-4ce0-8633-10e6dd1c5e2b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:07.027962 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-a389422d-fa6e-4ce0-8633-10e6dd1c5e2b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:07.036191 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-a389422d-fa6e-4ce0-8633-10e6dd1c5e2b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:07.037782 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-a389422d-fa6e-4ce0-8633-10e6dd1c5e2b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:07.038891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-a389422d-fa6e-4ce0-8633-10e6dd1c5e2b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.149672 May 12 11:48:07.039441 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 232/473] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:48:06 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:48:07.839521 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-7307c9a0-94ec-4aba-b081-dba91749982c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:07.840089 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-7307c9a0-94ec-4aba-b081-dba91749982c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:07.846453 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7307c9a0-94ec-4aba-b081-dba91749982c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:07.846908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7307c9a0-94ec-4aba-b081-dba91749982c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:07.847686 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7307c9a0-94ec-4aba-b081-dba91749982c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:07.848122 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7307c9a0-94ec-4aba-b081-dba91749982c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:07.970417 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-7307c9a0-94ec-4aba-b081-dba91749982c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:07.977515 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-7307c9a0-94ec-4aba-b081-dba91749982c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6" status: 200 len: 1319 microversion: 2.1 time: 0.142557 May 12 11:48:07.978121 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 242/474] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:07 2022] GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6 => generated 1319 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:08.056811 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-a4bc3e2c-2607-4605-b61c-8186559c55cb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:08.057421 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-a4bc3e2c-2607-4605-b61c-8186559c55cb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:08.063671 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a4bc3e2c-2607-4605-b61c-8186559c55cb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:08.064119 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a4bc3e2c-2607-4605-b61c-8186559c55cb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:08.064880 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a4bc3e2c-2607-4605-b61c-8186559c55cb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:08.065311 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a4bc3e2c-2607-4605-b61c-8186559c55cb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:08.194502 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-a4bc3e2c-2607-4605-b61c-8186559c55cb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:08.203648 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-a4bc3e2c-2607-4605-b61c-8186559c55cb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:08.205148 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-a4bc3e2c-2607-4605-b61c-8186559c55cb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:08.206347 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-a4bc3e2c-2607-4605-b61c-8186559c55cb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.153298 May 12 11:48:08.206897 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 233/475] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:48:08 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:48:08.994285 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-0d02899f-a42d-43ea-856f-c594e5a7e08c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:08.995000 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-0d02899f-a42d-43ea-856f-c594e5a7e08c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:09.001433 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0d02899f-a42d-43ea-856f-c594e5a7e08c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:09.001927 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0d02899f-a42d-43ea-856f-c594e5a7e08c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:09.002711 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0d02899f-a42d-43ea-856f-c594e5a7e08c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:09.003155 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0d02899f-a42d-43ea-856f-c594e5a7e08c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:09.125823 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-0d02899f-a42d-43ea-856f-c594e5a7e08c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:09.132944 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-0d02899f-a42d-43ea-856f-c594e5a7e08c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6" status: 200 len: 1319 microversion: 2.1 time: 0.143499 May 12 11:48:09.133506 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 243/476] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:08 2022] GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:09.224222 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-4384f0a6-33ad-4085-9aba-ecf56cf9167a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:09.224830 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-4384f0a6-33ad-4085-9aba-ecf56cf9167a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:09.231642 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4384f0a6-33ad-4085-9aba-ecf56cf9167a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:09.232088 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4384f0a6-33ad-4085-9aba-ecf56cf9167a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:09.232848 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4384f0a6-33ad-4085-9aba-ecf56cf9167a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:09.233281 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4384f0a6-33ad-4085-9aba-ecf56cf9167a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:09.358523 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-4384f0a6-33ad-4085-9aba-ecf56cf9167a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:09.367270 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-4384f0a6-33ad-4085-9aba-ecf56cf9167a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:09.369404 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-4384f0a6-33ad-4085-9aba-ecf56cf9167a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:09.370699 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-4384f0a6-33ad-4085-9aba-ecf56cf9167a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.150307 May 12 11:48:09.371266 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 234/477] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:48:09 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:48:10.150180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-d380f7db-991f-4ceb-97f1-20a245962081 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:10.150824 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d380f7db-991f-4ceb-97f1-20a245962081 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:10.157224 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d380f7db-991f-4ceb-97f1-20a245962081 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:10.157679 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d380f7db-991f-4ceb-97f1-20a245962081 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:10.158777 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d380f7db-991f-4ceb-97f1-20a245962081 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:10.159223 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d380f7db-991f-4ceb-97f1-20a245962081 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:10.291563 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-d380f7db-991f-4ceb-97f1-20a245962081 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:10.298780 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-d380f7db-991f-4ceb-97f1-20a245962081 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6" status: 200 len: 1319 microversion: 2.1 time: 0.152464 May 12 11:48:10.299356 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 244/478] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:10 2022] GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:10.390634 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-1e128c79-f1e2-43ab-b189-55c02e0767fb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:10.391536 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-1e128c79-f1e2-43ab-b189-55c02e0767fb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:10.397972 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1e128c79-f1e2-43ab-b189-55c02e0767fb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:10.398418 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1e128c79-f1e2-43ab-b189-55c02e0767fb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:10.399179 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1e128c79-f1e2-43ab-b189-55c02e0767fb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:10.400114 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1e128c79-f1e2-43ab-b189-55c02e0767fb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:10.527855 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-1e128c79-f1e2-43ab-b189-55c02e0767fb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:10.536070 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-1e128c79-f1e2-43ab-b189-55c02e0767fb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:10.537574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-1e128c79-f1e2-43ab-b189-55c02e0767fb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:10.538758 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-1e128c79-f1e2-43ab-b189-55c02e0767fb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.152346 May 12 11:48:10.539318 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 235/479] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:48:10 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:48:11.316230 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-fdf1dae3-517b-4db6-8ac0-b597d097689a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:11.316849 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-fdf1dae3-517b-4db6-8ac0-b597d097689a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:11.323798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fdf1dae3-517b-4db6-8ac0-b597d097689a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:11.324258 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fdf1dae3-517b-4db6-8ac0-b597d097689a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:11.325036 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fdf1dae3-517b-4db6-8ac0-b597d097689a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:11.325476 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fdf1dae3-517b-4db6-8ac0-b597d097689a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:11.457998 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-fdf1dae3-517b-4db6-8ac0-b597d097689a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:11.465241 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-fdf1dae3-517b-4db6-8ac0-b597d097689a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6" status: 200 len: 1319 microversion: 2.1 time: 0.153121 May 12 11:48:11.465822 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 245/480] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:11 2022] GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:11.557949 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-8a469171-dcfc-487c-8276-58580cffdec5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:11.558562 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-8a469171-dcfc-487c-8276-58580cffdec5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:11.564866 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8a469171-dcfc-487c-8276-58580cffdec5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:11.565317 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8a469171-dcfc-487c-8276-58580cffdec5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:11.566115 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8a469171-dcfc-487c-8276-58580cffdec5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:11.566551 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8a469171-dcfc-487c-8276-58580cffdec5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:11.601416 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-6f953264-ef69-41a8-b74f-075f134aac20 req-a1ca4e37-6c89-47e3-854a-99570c322a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5cd2aad-2374-4ded-8b72-2e54fbbad916", "name": "network-vif-plugged", "status": "completed", "tag": "d3632d97-f0ea-41b4-9003-a50ffebf91df"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:48:11.610587 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-6f953264-ef69-41a8-b74f-075f134aac20 req-a1ca4e37-6c89-47e3-854a-99570c322a10 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:11.611025 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-6f953264-ef69-41a8-b74f-075f134aac20 req-a1ca4e37-6c89-47e3-854a-99570c322a10 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:11.623020 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-6f953264-ef69-41a8-b74f-075f134aac20 req-a1ca4e37-6c89-47e3-854a-99570c322a10 service nova] Creating event network-vif-plugged:d3632d97-f0ea-41b4-9003-a50ffebf91df for instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 on hv-cinder-80473 May 12 11:48:11.627985 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-6f953264-ef69-41a8-b74f-075f134aac20 req-a1ca4e37-6c89-47e3-854a-99570c322a10 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030551 May 12 11:48:11.628587 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 246/481] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:48:11.712219 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-8a469171-dcfc-487c-8276-58580cffdec5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:11.720481 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-8a469171-dcfc-487c-8276-58580cffdec5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:11.722099 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-8a469171-dcfc-487c-8276-58580cffdec5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:11.723263 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-8a469171-dcfc-487c-8276-58580cffdec5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.170053 May 12 11:48:11.723830 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 236/482] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:48:11 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:48:12.482715 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-5304f935-aa72-435a-a029-2d00b5f694ad tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:12.483415 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-5304f935-aa72-435a-a029-2d00b5f694ad tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:12.489504 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5304f935-aa72-435a-a029-2d00b5f694ad tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:12.489987 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5304f935-aa72-435a-a029-2d00b5f694ad tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:12.490749 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5304f935-aa72-435a-a029-2d00b5f694ad tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:12.491186 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5304f935-aa72-435a-a029-2d00b5f694ad tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:12.615501 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-5304f935-aa72-435a-a029-2d00b5f694ad tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:12.623211 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-5304f935-aa72-435a-a029-2d00b5f694ad tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6" status: 200 len: 1319 microversion: 2.1 time: 0.145123 May 12 11:48:12.623881 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 247/483] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:12 2022] GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:12.741197 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-bbf520d7-6832-4dcb-b456-0ff653ff0a29 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:12.741836 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-bbf520d7-6832-4dcb-b456-0ff653ff0a29 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:12.749619 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bbf520d7-6832-4dcb-b456-0ff653ff0a29 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:12.750095 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bbf520d7-6832-4dcb-b456-0ff653ff0a29 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:12.750870 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bbf520d7-6832-4dcb-b456-0ff653ff0a29 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:12.751312 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bbf520d7-6832-4dcb-b456-0ff653ff0a29 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:12.878155 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-bbf520d7-6832-4dcb-b456-0ff653ff0a29 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:12.887164 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-bbf520d7-6832-4dcb-b456-0ff653ff0a29 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:12.888650 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-bbf520d7-6832-4dcb-b456-0ff653ff0a29 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:12.889842 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-bbf520d7-6832-4dcb-b456-0ff653ff0a29 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.152446 May 12 11:48:12.890378 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 237/484] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:48:12 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:48:13.640570 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-507e55c9-326f-4887-95e7-719e17563f1a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:13.641192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-507e55c9-326f-4887-95e7-719e17563f1a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:13.643515 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-b509615c-1490-4e4d-b643-b483d4e4ab27 req-12818493-e87e-43f5-b4a3-16e560fd9121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4394d3b-8300-4ce2-837d-65d1e01cc7c6", "name": "network-vif-plugged", "status": "completed", "tag": "7d624a29-c293-4840-b98d-df28f56aaff7"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:48:13.647763 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-507e55c9-326f-4887-95e7-719e17563f1a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:13.648224 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-507e55c9-326f-4887-95e7-719e17563f1a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:13.648992 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-507e55c9-326f-4887-95e7-719e17563f1a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:13.649432 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-507e55c9-326f-4887-95e7-719e17563f1a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:13.651992 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-b509615c-1490-4e4d-b643-b483d4e4ab27 req-12818493-e87e-43f5-b4a3-16e560fd9121 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:13.652441 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-b509615c-1490-4e4d-b643-b483d4e4ab27 req-12818493-e87e-43f5-b4a3-16e560fd9121 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:13.663853 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-b509615c-1490-4e4d-b643-b483d4e4ab27 req-12818493-e87e-43f5-b4a3-16e560fd9121 service nova] Creating event network-vif-plugged:7d624a29-c293-4840-b98d-df28f56aaff7 for instance a4394d3b-8300-4ce2-837d-65d1e01cc7c6 on hv-cinder-80473 May 12 11:48:13.668659 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-b509615c-1490-4e4d-b643-b483d4e4ab27 req-12818493-e87e-43f5-b4a3-16e560fd9121 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028677 May 12 11:48:13.669252 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 238/485] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:48:13.777410 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-507e55c9-326f-4887-95e7-719e17563f1a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:13.784524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-507e55c9-326f-4887-95e7-719e17563f1a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6" status: 200 len: 1319 microversion: 2.1 time: 0.147861 May 12 11:48:13.785422 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 248/486] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:13 2022] GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:13.907879 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-ceafa378-f05d-484c-ad35-0a55932d3eb7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:13.908515 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-ceafa378-f05d-484c-ad35-0a55932d3eb7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:13.914727 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ceafa378-f05d-484c-ad35-0a55932d3eb7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:13.915674 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ceafa378-f05d-484c-ad35-0a55932d3eb7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:13.916433 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ceafa378-f05d-484c-ad35-0a55932d3eb7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:13.916863 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ceafa378-f05d-484c-ad35-0a55932d3eb7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:14.045973 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-ceafa378-f05d-484c-ad35-0a55932d3eb7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:14.054125 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-ceafa378-f05d-484c-ad35-0a55932d3eb7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:14.056241 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-ceafa378-f05d-484c-ad35-0a55932d3eb7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:14.057382 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-ceafa378-f05d-484c-ad35-0a55932d3eb7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.154192 May 12 11:48:14.057973 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 239/487] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:48:13 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:48:14.717244 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b3c96398-3a67-48fb-817e-cb8a6d08041e tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:48:14.718394 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-b3c96398-3a67-48fb-817e-cb8a6d08041e tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:14.724830 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b3c96398-3a67-48fb-817e-cb8a6d08041e tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:14.725465 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b3c96398-3a67-48fb-817e-cb8a6d08041e tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:14.726288 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b3c96398-3a67-48fb-817e-cb8a6d08041e tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:14.726722 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b3c96398-3a67-48fb-817e-cb8a6d08041e tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:14.801506 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-b3c96398-3a67-48fb-817e-cb8a6d08041e tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "POST /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909/action" status: 202 len: 0 microversion: 2.1 time: 0.087748 May 12 11:48:14.807399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 249/488] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 12 11:48:14 2022] POST /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:48:14.807544 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-f2620df3-1b8a-4c2e-9ee7-275d4b4137c1 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:14.807544 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-f2620df3-1b8a-4c2e-9ee7-275d4b4137c1 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:14.812293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-e182fd25-7db1-40e2-881d-fa830984c24e tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:14.812447 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f2620df3-1b8a-4c2e-9ee7-275d4b4137c1 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:14.812806 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f2620df3-1b8a-4c2e-9ee7-275d4b4137c1 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:14.813097 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-e182fd25-7db1-40e2-881d-fa830984c24e tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:14.813580 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f2620df3-1b8a-4c2e-9ee7-275d4b4137c1 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:14.814150 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f2620df3-1b8a-4c2e-9ee7-275d4b4137c1 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:14.819868 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e182fd25-7db1-40e2-881d-fa830984c24e tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:14.820492 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e182fd25-7db1-40e2-881d-fa830984c24e tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:14.821362 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e182fd25-7db1-40e2-881d-fa830984c24e tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:14.821909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e182fd25-7db1-40e2-881d-fa830984c24e tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:14.959560 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-f2620df3-1b8a-4c2e-9ee7-275d4b4137c1 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:14.967448 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-f2620df3-1b8a-4c2e-9ee7-275d4b4137c1 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6" status: 200 len: 1319 microversion: 2.1 time: 0.169508 May 12 11:48:14.968021 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 240/489] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:14 2022] GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:14.971982 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-e182fd25-7db1-40e2-881d-fa830984c24e tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:14.980261 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-e182fd25-7db1-40e2-881d-fa830984c24e tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1749 microversion: 2.1 time: 0.172608 May 12 11:48:14.980819 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 250/490] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:14 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1749 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:15.075168 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-35449f97-c14e-4720-bc32-ea67b7cb23f7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:15.075701 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-35449f97-c14e-4720-bc32-ea67b7cb23f7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:15.082006 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-35449f97-c14e-4720-bc32-ea67b7cb23f7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:15.082452 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-35449f97-c14e-4720-bc32-ea67b7cb23f7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:15.083207 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-35449f97-c14e-4720-bc32-ea67b7cb23f7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:15.083640 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-35449f97-c14e-4720-bc32-ea67b7cb23f7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:15.210928 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-35449f97-c14e-4720-bc32-ea67b7cb23f7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:15.219676 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-35449f97-c14e-4720-bc32-ea67b7cb23f7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:15.221177 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-35449f97-c14e-4720-bc32-ea67b7cb23f7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:15.222360 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-35449f97-c14e-4720-bc32-ea67b7cb23f7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1807 microversion: 2.20 time: 0.151134 May 12 11:48:15.222928 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 241/491] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:48:15 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:48:15.984425 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-8e6dbad1-d0be-4184-9876-c363597ef6fd tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:15.985069 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-8e6dbad1-d0be-4184-9876-c363597ef6fd tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:15.991648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8e6dbad1-d0be-4184-9876-c363597ef6fd tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:15.992317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8e6dbad1-d0be-4184-9876-c363597ef6fd tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:15.993942 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8e6dbad1-d0be-4184-9876-c363597ef6fd tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:15.994522 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8e6dbad1-d0be-4184-9876-c363597ef6fd tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:15.997996 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-decaa159-e4e5-448f-b54b-154404d6e86c tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:15.998606 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-decaa159-e4e5-448f-b54b-154404d6e86c tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:16.004793 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-decaa159-e4e5-448f-b54b-154404d6e86c tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:16.005222 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-decaa159-e4e5-448f-b54b-154404d6e86c tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:16.006013 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-decaa159-e4e5-448f-b54b-154404d6e86c tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:16.006448 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-decaa159-e4e5-448f-b54b-154404d6e86c tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:16.145309 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-decaa159-e4e5-448f-b54b-154404d6e86c tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:16.153168 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-decaa159-e4e5-448f-b54b-154404d6e86c tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1749 microversion: 2.1 time: 0.158918 May 12 11:48:16.153877 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 242/492] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:15 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:16.173763 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8e6dbad1-d0be-4184-9876-c363597ef6fd tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:16.181739 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-8e6dbad1-d0be-4184-9876-c363597ef6fd tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6" status: 200 len: 1319 microversion: 2.1 time: 0.201119 May 12 11:48:16.182307 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 251/493] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:15 2022] GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:16.240393 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-e3e8717a-4068-4046-9ac9-654d3141ca14 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:16.240914 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-e3e8717a-4068-4046-9ac9-654d3141ca14 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:16.247981 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e3e8717a-4068-4046-9ac9-654d3141ca14 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:16.248430 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e3e8717a-4068-4046-9ac9-654d3141ca14 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:16.249199 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e3e8717a-4068-4046-9ac9-654d3141ca14 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:16.249645 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e3e8717a-4068-4046-9ac9-654d3141ca14 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:16.381197 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-e3e8717a-4068-4046-9ac9-654d3141ca14 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:16.389663 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-e3e8717a-4068-4046-9ac9-654d3141ca14 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:16.391196 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-e3e8717a-4068-4046-9ac9-654d3141ca14 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:16.392366 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-e3e8717a-4068-4046-9ac9-654d3141ca14 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1794 microversion: 2.20 time: 0.155949 May 12 11:48:16.392921 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 243/494] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:48:16 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1794 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:48:17.171062 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-3b4fcfb2-1ade-400f-98bc-c47e82f8f4b9 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:17.171675 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-3b4fcfb2-1ade-400f-98bc-c47e82f8f4b9 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:17.178068 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3b4fcfb2-1ade-400f-98bc-c47e82f8f4b9 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:17.178524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3b4fcfb2-1ade-400f-98bc-c47e82f8f4b9 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:17.179292 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3b4fcfb2-1ade-400f-98bc-c47e82f8f4b9 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:17.179732 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3b4fcfb2-1ade-400f-98bc-c47e82f8f4b9 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:17.198110 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-e1068b5c-2e4d-4388-9443-aeb8db7a3071 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:17.198811 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-e1068b5c-2e4d-4388-9443-aeb8db7a3071 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:17.205247 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e1068b5c-2e4d-4388-9443-aeb8db7a3071 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:17.205689 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e1068b5c-2e4d-4388-9443-aeb8db7a3071 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:17.206494 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e1068b5c-2e4d-4388-9443-aeb8db7a3071 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:17.206929 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e1068b5c-2e4d-4388-9443-aeb8db7a3071 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:17.318101 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-3b4fcfb2-1ade-400f-98bc-c47e82f8f4b9 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:17.326607 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-3b4fcfb2-1ade-400f-98bc-c47e82f8f4b9 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1754 microversion: 2.1 time: 0.159152 May 12 11:48:17.327172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 252/495] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:17 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:17.339751 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-e1068b5c-2e4d-4388-9443-aeb8db7a3071 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:17.346887 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-e1068b5c-2e4d-4388-9443-aeb8db7a3071 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6" status: 200 len: 1508 microversion: 2.1 time: 0.152559 May 12 11:48:17.347437 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 244/496] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:17 2022] GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:48:18.343729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-fbd1da89-e8f3-48ad-b20c-03c6463dc1cf tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:18.344324 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-fbd1da89-e8f3-48ad-b20c-03c6463dc1cf tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:18.350894 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fbd1da89-e8f3-48ad-b20c-03c6463dc1cf tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:18.351344 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fbd1da89-e8f3-48ad-b20c-03c6463dc1cf tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:18.352106 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fbd1da89-e8f3-48ad-b20c-03c6463dc1cf tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:18.352542 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fbd1da89-e8f3-48ad-b20c-03c6463dc1cf tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:18.500104 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-fbd1da89-e8f3-48ad-b20c-03c6463dc1cf tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:18.507978 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-fbd1da89-e8f3-48ad-b20c-03c6463dc1cf tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1754 microversion: 2.1 time: 0.168102 May 12 11:48:18.508541 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 253/497] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:18 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:19.524337 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-98879ad3-deaa-46d1-a40c-a17a2d27e616 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:19.524944 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-98879ad3-deaa-46d1-a40c-a17a2d27e616 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:19.531997 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-98879ad3-deaa-46d1-a40c-a17a2d27e616 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:19.532448 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-98879ad3-deaa-46d1-a40c-a17a2d27e616 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:19.533215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-98879ad3-deaa-46d1-a40c-a17a2d27e616 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:19.533652 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-98879ad3-deaa-46d1-a40c-a17a2d27e616 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:19.675720 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-98879ad3-deaa-46d1-a40c-a17a2d27e616 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:19.683631 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-98879ad3-deaa-46d1-a40c-a17a2d27e616 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1754 microversion: 2.1 time: 0.163117 May 12 11:48:19.684202 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 245/498] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:19 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:48:20.704791 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-91649787-f29e-4bdb-a8b1-127ab1b68095 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:20.705398 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-91649787-f29e-4bdb-a8b1-127ab1b68095 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:20.711315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-91649787-f29e-4bdb-a8b1-127ab1b68095 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:20.711764 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-91649787-f29e-4bdb-a8b1-127ab1b68095 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:20.712527 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-91649787-f29e-4bdb-a8b1-127ab1b68095 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:20.712962 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-91649787-f29e-4bdb-a8b1-127ab1b68095 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:20.856601 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-91649787-f29e-4bdb-a8b1-127ab1b68095 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:20.864428 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-91649787-f29e-4bdb-a8b1-127ab1b68095 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1754 microversion: 2.1 time: 0.163822 May 12 11:48:20.865000 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 254/499] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:20 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:21.883002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-1040f2a0-ae59-4731-8ffc-76603a674ab6 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:21.883515 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-1040f2a0-ae59-4731-8ffc-76603a674ab6 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:21.889871 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1040f2a0-ae59-4731-8ffc-76603a674ab6 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:21.890324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1040f2a0-ae59-4731-8ffc-76603a674ab6 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:21.891119 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1040f2a0-ae59-4731-8ffc-76603a674ab6 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:21.891640 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1040f2a0-ae59-4731-8ffc-76603a674ab6 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:22.042113 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-1040f2a0-ae59-4731-8ffc-76603a674ab6 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:22.050162 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-1040f2a0-ae59-4731-8ffc-76603a674ab6 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1754 microversion: 2.1 time: 0.171356 May 12 11:48:22.050725 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 246/500] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:21 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:23.067451 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ba555345-5b88-456b-ba9d-e38d8d351f39 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:23.068093 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-ba555345-5b88-456b-ba9d-e38d8d351f39 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:23.075297 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ba555345-5b88-456b-ba9d-e38d8d351f39 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:23.075743 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ba555345-5b88-456b-ba9d-e38d8d351f39 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:23.076785 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ba555345-5b88-456b-ba9d-e38d8d351f39 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:23.077229 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ba555345-5b88-456b-ba9d-e38d8d351f39 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:23.217092 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-ba555345-5b88-456b-ba9d-e38d8d351f39 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:23.224951 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-ba555345-5b88-456b-ba9d-e38d8d351f39 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1754 microversion: 2.1 time: 0.161661 May 12 11:48:23.225529 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 255/501] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:23 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:24.241669 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-ee6da2a9-bd2b-48c4-b6b1-c885d7f1a910 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:24.242304 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-ee6da2a9-bd2b-48c4-b6b1-c885d7f1a910 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:24.249718 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ee6da2a9-bd2b-48c4-b6b1-c885d7f1a910 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:24.250169 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ee6da2a9-bd2b-48c4-b6b1-c885d7f1a910 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:24.250946 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ee6da2a9-bd2b-48c4-b6b1-c885d7f1a910 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:24.251374 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ee6da2a9-bd2b-48c4-b6b1-c885d7f1a910 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:24.393553 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-ee6da2a9-bd2b-48c4-b6b1-c885d7f1a910 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:24.401408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-ee6da2a9-bd2b-48c4-b6b1-c885d7f1a910 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1754 microversion: 2.1 time: 0.163578 May 12 11:48:24.402009 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 247/502] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:24 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:25.418582 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b9645227-c579-432b-a0f2-bb20d2688487 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:25.419149 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-b9645227-c579-432b-a0f2-bb20d2688487 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:25.425421 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b9645227-c579-432b-a0f2-bb20d2688487 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:25.425907 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b9645227-c579-432b-a0f2-bb20d2688487 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:25.426679 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b9645227-c579-432b-a0f2-bb20d2688487 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:25.427121 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b9645227-c579-432b-a0f2-bb20d2688487 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:25.579866 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b9645227-c579-432b-a0f2-bb20d2688487 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:25.587910 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-b9645227-c579-432b-a0f2-bb20d2688487 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1754 microversion: 2.1 time: 0.173243 May 12 11:48:25.588517 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 256/503] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:25 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:26.604745 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-3b4c6182-a1d9-4362-89ec-a435472e7a02 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:26.605349 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-3b4c6182-a1d9-4362-89ec-a435472e7a02 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:26.611732 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3b4c6182-a1d9-4362-89ec-a435472e7a02 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:26.612182 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3b4c6182-a1d9-4362-89ec-a435472e7a02 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:26.612986 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3b4c6182-a1d9-4362-89ec-a435472e7a02 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:26.613505 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3b4c6182-a1d9-4362-89ec-a435472e7a02 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:26.758865 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-3b4c6182-a1d9-4362-89ec-a435472e7a02 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:26.766725 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-3b4c6182-a1d9-4362-89ec-a435472e7a02 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1754 microversion: 2.1 time: 0.166345 May 12 11:48:26.767297 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 248/504] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:26 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:27.418047 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-eff41cb5-6f73-434f-b753-da7887e39755 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "244b7dcc-8b0f-4eed-b4fd-b340a1811947"}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:48:27.419042 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-eff41cb5-6f73-434f-b753-da7887e39755 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:27.425354 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-eff41cb5-6f73-434f-b753-da7887e39755 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:27.425845 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-eff41cb5-6f73-434f-b753-da7887e39755 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:27.426624 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-eff41cb5-6f73-434f-b753-da7887e39755 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:27.427064 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-eff41cb5-6f73-434f-b753-da7887e39755 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:27.703690 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-eff41cb5-6f73-434f-b753-da7887e39755 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "POST /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289568 May 12 11:48:27.704309 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 257/505] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 12 11:48:27 2022] POST /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:48:27.784581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-920893c3-a0e7-4529-8aa8-c6273ffd62c8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:27.785147 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-920893c3-a0e7-4529-8aa8-c6273ffd62c8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:27.791772 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-920893c3-a0e7-4529-8aa8-c6273ffd62c8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:27.792224 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-920893c3-a0e7-4529-8aa8-c6273ffd62c8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:27.793027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-920893c3-a0e7-4529-8aa8-c6273ffd62c8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:27.793470 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-920893c3-a0e7-4529-8aa8-c6273ffd62c8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:27.934406 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-920893c3-a0e7-4529-8aa8-c6273ffd62c8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:27.942194 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-920893c3-a0e7-4529-8aa8-c6273ffd62c8 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1754 microversion: 2.1 time: 0.161516 May 12 11:48:27.942757 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 249/506] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:27 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:28.961265 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-5cf88203-1b0c-4f02-8368-dde8adff4d62 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:28.962094 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-5cf88203-1b0c-4f02-8368-dde8adff4d62 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:28.968371 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5cf88203-1b0c-4f02-8368-dde8adff4d62 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:28.968819 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5cf88203-1b0c-4f02-8368-dde8adff4d62 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:28.969590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5cf88203-1b0c-4f02-8368-dde8adff4d62 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:28.970043 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5cf88203-1b0c-4f02-8368-dde8adff4d62 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:29.110079 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-5cf88203-1b0c-4f02-8368-dde8adff4d62 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:29.117949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-5cf88203-1b0c-4f02-8368-dde8adff4d62 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1754 microversion: 2.1 time: 0.161353 May 12 11:48:29.118509 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 258/507] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:28 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:30.135487 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-4a0dd795-5e5b-42c7-be50-65f64cb317ce tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:30.136109 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-4a0dd795-5e5b-42c7-be50-65f64cb317ce tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:30.142549 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4a0dd795-5e5b-42c7-be50-65f64cb317ce tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:30.143008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4a0dd795-5e5b-42c7-be50-65f64cb317ce tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:30.143810 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4a0dd795-5e5b-42c7-be50-65f64cb317ce tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:30.144247 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4a0dd795-5e5b-42c7-be50-65f64cb317ce tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:30.280765 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-4a0dd795-5e5b-42c7-be50-65f64cb317ce tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:30.288529 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-4a0dd795-5e5b-42c7-be50-65f64cb317ce tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1754 microversion: 2.1 time: 0.156865 May 12 11:48:30.289432 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 250/508] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:30 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:31.306060 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-f80e4570-3986-4c54-9c16-b6f93d925b9a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:31.306676 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-f80e4570-3986-4c54-9c16-b6f93d925b9a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:31.313142 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f80e4570-3986-4c54-9c16-b6f93d925b9a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:31.313624 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f80e4570-3986-4c54-9c16-b6f93d925b9a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:31.314431 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f80e4570-3986-4c54-9c16-b6f93d925b9a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:31.314873 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f80e4570-3986-4c54-9c16-b6f93d925b9a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:31.456903 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-f80e4570-3986-4c54-9c16-b6f93d925b9a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:31.465337 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-f80e4570-3986-4c54-9c16-b6f93d925b9a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1754 microversion: 2.1 time: 0.162513 May 12 11:48:31.465969 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 259/509] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:31 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:32.482906 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-6729d6f7-d604-476a-acf3-f83020062d0a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:32.483500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-6729d6f7-d604-476a-acf3-f83020062d0a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:32.489725 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6729d6f7-d604-476a-acf3-f83020062d0a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:32.490182 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6729d6f7-d604-476a-acf3-f83020062d0a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:32.490936 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6729d6f7-d604-476a-acf3-f83020062d0a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:32.491365 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6729d6f7-d604-476a-acf3-f83020062d0a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:32.630646 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-6729d6f7-d604-476a-acf3-f83020062d0a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:32.638312 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-6729d6f7-d604-476a-acf3-f83020062d0a tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1754 microversion: 2.1 time: 0.159874 May 12 11:48:32.638877 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 251/510] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:32 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:33.654769 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-650675a1-6f4e-4d03-8f5c-80852f91ac7d tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:33.655383 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-650675a1-6f4e-4d03-8f5c-80852f91ac7d tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:33.661684 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-650675a1-6f4e-4d03-8f5c-80852f91ac7d tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:33.662168 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-650675a1-6f4e-4d03-8f5c-80852f91ac7d tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:33.662941 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-650675a1-6f4e-4d03-8f5c-80852f91ac7d tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:33.663381 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-650675a1-6f4e-4d03-8f5c-80852f91ac7d tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:33.799478 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-650675a1-6f4e-4d03-8f5c-80852f91ac7d tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:33.807227 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-650675a1-6f4e-4d03-8f5c-80852f91ac7d tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1754 microversion: 2.1 time: 0.156264 May 12 11:48:33.807785 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 260/511] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:33 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:34.825103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-b14997bd-a94d-42e8-8f0d-b13abd944e01 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:34.825859 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-b14997bd-a94d-42e8-8f0d-b13abd944e01 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:34.832525 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b14997bd-a94d-42e8-8f0d-b13abd944e01 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:34.832973 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b14997bd-a94d-42e8-8f0d-b13abd944e01 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:34.833770 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b14997bd-a94d-42e8-8f0d-b13abd944e01 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:34.834212 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b14997bd-a94d-42e8-8f0d-b13abd944e01 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:34.974267 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b14997bd-a94d-42e8-8f0d-b13abd944e01 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:34.982142 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-b14997bd-a94d-42e8-8f0d-b13abd944e01 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1754 microversion: 2.1 time: 0.161385 May 12 11:48:34.982710 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 252/512] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:34 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:35.557867 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-f44bd427-fce2-4cae-90ac-363a6e047886 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a64e8b7-23ad-49e2-922e-db58d223daa6", "device": "/dev/sdb"}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:48:35.560079 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-f44bd427-fce2-4cae-90ac-363a6e047886 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:35.566041 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f44bd427-fce2-4cae-90ac-363a6e047886 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:35.566509 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f44bd427-fce2-4cae-90ac-363a6e047886 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:35.567276 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f44bd427-fce2-4cae-90ac-363a6e047886 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:35.567709 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f44bd427-fce2-4cae-90ac-363a6e047886 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:35.808962 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-f44bd427-fce2-4cae-90ac-363a6e047886 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "POST /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254291 May 12 11:48:35.809579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 261/513] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 12 11:48:35 2022] POST /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:48:35.999811 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-7c3c8dc5-dcd5-4764-a5f3-607a84cb4b48 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:36.000424 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-7c3c8dc5-dcd5-4764-a5f3-607a84cb4b48 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:36.006442 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7c3c8dc5-dcd5-4764-a5f3-607a84cb4b48 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:36.006891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7c3c8dc5-dcd5-4764-a5f3-607a84cb4b48 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:36.007713 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7c3c8dc5-dcd5-4764-a5f3-607a84cb4b48 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:36.008083 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7c3c8dc5-dcd5-4764-a5f3-607a84cb4b48 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:36.148660 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-7c3c8dc5-dcd5-4764-a5f3-607a84cb4b48 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:36.156522 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-7c3c8dc5-dcd5-4764-a5f3-607a84cb4b48 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1754 microversion: 2.1 time: 0.161069 May 12 11:48:36.157088 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 253/514] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:35 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:36.219835 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-f6d8e1e5-41d1-43aa-b1a7-f96e7bcbef7b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:48:36.220906 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-f6d8e1e5-41d1-43aa-b1a7-f96e7bcbef7b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:36.226989 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f6d8e1e5-41d1-43aa-b1a7-f96e7bcbef7b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:36.227443 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f6d8e1e5-41d1-43aa-b1a7-f96e7bcbef7b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:36.228205 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f6d8e1e5-41d1-43aa-b1a7-f96e7bcbef7b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:36.228640 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f6d8e1e5-41d1-43aa-b1a7-f96e7bcbef7b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:36.250841 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.objects.instance [None req-f6d8e1e5-41d1-43aa-b1a7-f96e7bcbef7b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lazy-loading 'flavor' on Instance uuid f609a10d-385a-4eb7-92b3-cfd766e53d22 {{(pid=123508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:48:36.403639 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-f6d8e1e5-41d1-43aa-b1a7-f96e7bcbef7b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "POST /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22/action" status: 200 len: 32 microversion: 2.1 time: 0.188929 May 12 11:48:36.404245 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 262/515] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 12 11:48:36 2022] POST /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22/action => generated 32 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 11:48:36.413088 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-59c5c743-b30e-4b70-925a-a3a1f502f9f1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:36.413724 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-59c5c743-b30e-4b70-925a-a3a1f502f9f1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:36.420258 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-59c5c743-b30e-4b70-925a-a3a1f502f9f1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:36.420708 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-59c5c743-b30e-4b70-925a-a3a1f502f9f1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:36.421487 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-59c5c743-b30e-4b70-925a-a3a1f502f9f1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:36.421960 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-59c5c743-b30e-4b70-925a-a3a1f502f9f1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:36.562006 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-59c5c743-b30e-4b70-925a-a3a1f502f9f1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:36.570056 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-59c5c743-b30e-4b70-925a-a3a1f502f9f1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1735 microversion: 2.1 time: 0.160592 May 12 11:48:36.570763 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 254/516] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:36 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:37.174887 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-7797819b-468c-4401-8f63-f8f17c572200 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:37.175526 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-7797819b-468c-4401-8f63-f8f17c572200 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:37.181867 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7797819b-468c-4401-8f63-f8f17c572200 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:37.182326 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7797819b-468c-4401-8f63-f8f17c572200 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:37.183098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7797819b-468c-4401-8f63-f8f17c572200 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:37.184118 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7797819b-468c-4401-8f63-f8f17c572200 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:37.325501 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-7797819b-468c-4401-8f63-f8f17c572200 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:37.333462 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-7797819b-468c-4401-8f63-f8f17c572200 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1754 microversion: 2.1 time: 0.163403 May 12 11:48:37.334064 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 263/517] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:37 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:37.587868 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-577bb4d5-176b-4922-95c1-7f4afe3d963a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:37.588766 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-577bb4d5-176b-4922-95c1-7f4afe3d963a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:37.594989 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-577bb4d5-176b-4922-95c1-7f4afe3d963a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:37.595435 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-577bb4d5-176b-4922-95c1-7f4afe3d963a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:37.596197 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-577bb4d5-176b-4922-95c1-7f4afe3d963a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:37.596633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-577bb4d5-176b-4922-95c1-7f4afe3d963a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:37.721273 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-577bb4d5-176b-4922-95c1-7f4afe3d963a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:37.729047 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-577bb4d5-176b-4922-95c1-7f4afe3d963a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1735 microversion: 2.1 time: 0.145015 May 12 11:48:37.729619 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 255/518] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:37 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:38.350299 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a6a33342-9e8f-4435-84e9-b7813f3b7be0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:38.350932 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-a6a33342-9e8f-4435-84e9-b7813f3b7be0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:38.357944 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a6a33342-9e8f-4435-84e9-b7813f3b7be0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:38.358395 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a6a33342-9e8f-4435-84e9-b7813f3b7be0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:38.359185 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a6a33342-9e8f-4435-84e9-b7813f3b7be0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:38.359643 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a6a33342-9e8f-4435-84e9-b7813f3b7be0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:38.497482 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-a6a33342-9e8f-4435-84e9-b7813f3b7be0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:38.505329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-a6a33342-9e8f-4435-84e9-b7813f3b7be0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1757 microversion: 2.1 time: 0.158856 May 12 11:48:38.506102 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 264/519] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:38 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:38.746685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-5125efb1-2ecc-4ef6-8d97-cb26cc85041a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:38.747299 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-5125efb1-2ecc-4ef6-8d97-cb26cc85041a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:38.753830 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5125efb1-2ecc-4ef6-8d97-cb26cc85041a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:38.754286 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5125efb1-2ecc-4ef6-8d97-cb26cc85041a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:38.755063 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5125efb1-2ecc-4ef6-8d97-cb26cc85041a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:38.755525 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5125efb1-2ecc-4ef6-8d97-cb26cc85041a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:38.883835 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-5125efb1-2ecc-4ef6-8d97-cb26cc85041a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:38.892430 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-5125efb1-2ecc-4ef6-8d97-cb26cc85041a tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1735 microversion: 2.1 time: 0.149688 May 12 11:48:38.892997 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 256/520] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:38 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:39.909083 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-29301b6e-0b82-4191-87be-fbb88a020353 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:39.909619 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-29301b6e-0b82-4191-87be-fbb88a020353 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:39.915938 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-29301b6e-0b82-4191-87be-fbb88a020353 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:39.916391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-29301b6e-0b82-4191-87be-fbb88a020353 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:39.917159 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-29301b6e-0b82-4191-87be-fbb88a020353 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:39.918244 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-29301b6e-0b82-4191-87be-fbb88a020353 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:40.043796 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-29301b6e-0b82-4191-87be-fbb88a020353 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:40.051747 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-29301b6e-0b82-4191-87be-fbb88a020353 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1735 microversion: 2.1 time: 0.146600 May 12 11:48:40.052321 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 265/521] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:39 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:41.068585 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-a192e964-cccf-458a-8d3a-d9aac6185d8b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:41.069185 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-a192e964-cccf-458a-8d3a-d9aac6185d8b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:41.075580 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a192e964-cccf-458a-8d3a-d9aac6185d8b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:41.076025 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a192e964-cccf-458a-8d3a-d9aac6185d8b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:41.077153 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a192e964-cccf-458a-8d3a-d9aac6185d8b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:41.077494 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a192e964-cccf-458a-8d3a-d9aac6185d8b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:41.204970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-a192e964-cccf-458a-8d3a-d9aac6185d8b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:41.212711 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-a192e964-cccf-458a-8d3a-d9aac6185d8b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1735 microversion: 2.1 time: 0.147906 May 12 11:48:41.213274 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 257/522] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:41 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:42.230363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-202b3069-769e-46aa-96a2-72b3833cb234 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:42.230962 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-202b3069-769e-46aa-96a2-72b3833cb234 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:42.237229 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-202b3069-769e-46aa-96a2-72b3833cb234 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:42.237670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-202b3069-769e-46aa-96a2-72b3833cb234 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:42.238467 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-202b3069-769e-46aa-96a2-72b3833cb234 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:42.238889 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-202b3069-769e-46aa-96a2-72b3833cb234 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:42.364635 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-202b3069-769e-46aa-96a2-72b3833cb234 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:42.372278 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-202b3069-769e-46aa-96a2-72b3833cb234 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1735 microversion: 2.1 time: 0.145682 May 12 11:48:42.372846 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 266/523] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:42 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:43.390378 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-4cc9a5a2-2373-4c63-ae75-d5b1f3620ffc tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:43.391036 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-4cc9a5a2-2373-4c63-ae75-d5b1f3620ffc tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:43.398159 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4cc9a5a2-2373-4c63-ae75-d5b1f3620ffc tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:43.398609 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4cc9a5a2-2373-4c63-ae75-d5b1f3620ffc tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:43.399389 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4cc9a5a2-2373-4c63-ae75-d5b1f3620ffc tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:43.399834 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4cc9a5a2-2373-4c63-ae75-d5b1f3620ffc tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:43.540216 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-4cc9a5a2-2373-4c63-ae75-d5b1f3620ffc tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:43.549761 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-4cc9a5a2-2373-4c63-ae75-d5b1f3620ffc tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1735 microversion: 2.1 time: 0.164254 May 12 11:48:43.550340 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 258/524] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:43 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:44.567219 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-1547a3b8-9af5-4a99-b0d2-070a9f1b15a6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:44.567835 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-1547a3b8-9af5-4a99-b0d2-070a9f1b15a6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:44.574399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1547a3b8-9af5-4a99-b0d2-070a9f1b15a6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:44.574894 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1547a3b8-9af5-4a99-b0d2-070a9f1b15a6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:44.575650 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1547a3b8-9af5-4a99-b0d2-070a9f1b15a6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:44.576086 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1547a3b8-9af5-4a99-b0d2-070a9f1b15a6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:44.699889 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-1547a3b8-9af5-4a99-b0d2-070a9f1b15a6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:44.707838 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-1547a3b8-9af5-4a99-b0d2-070a9f1b15a6 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1735 microversion: 2.1 time: 0.144438 May 12 11:48:44.708412 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 267/525] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:44 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:45.725323 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-68f518c1-0b78-4062-b4c9-6a7d488a38e9 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:45.725879 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-68f518c1-0b78-4062-b4c9-6a7d488a38e9 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:45.732695 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-68f518c1-0b78-4062-b4c9-6a7d488a38e9 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:45.733135 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-68f518c1-0b78-4062-b4c9-6a7d488a38e9 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:45.733929 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-68f518c1-0b78-4062-b4c9-6a7d488a38e9 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:45.734358 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-68f518c1-0b78-4062-b4c9-6a7d488a38e9 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:45.859052 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-68f518c1-0b78-4062-b4c9-6a7d488a38e9 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:45.866599 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-68f518c1-0b78-4062-b4c9-6a7d488a38e9 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1735 microversion: 2.1 time: 0.145119 May 12 11:48:45.867162 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 259/526] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:45 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:46.882524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-90614615-e185-439c-8b0b-bf7e24ca3ae4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:46.883119 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-90614615-e185-439c-8b0b-bf7e24ca3ae4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:46.889999 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-90614615-e185-439c-8b0b-bf7e24ca3ae4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:46.890456 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-90614615-e185-439c-8b0b-bf7e24ca3ae4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:46.891230 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-90614615-e185-439c-8b0b-bf7e24ca3ae4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:46.891671 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-90614615-e185-439c-8b0b-bf7e24ca3ae4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:47.029527 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-90614615-e185-439c-8b0b-bf7e24ca3ae4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:47.037792 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-90614615-e185-439c-8b0b-bf7e24ca3ae4 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1735 microversion: 2.1 time: 0.159046 May 12 11:48:47.038360 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 268/527] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:46 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:48:48.055558 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-67d8d941-f524-440a-9ae7-34194ffa4130 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:48.056169 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-67d8d941-f524-440a-9ae7-34194ffa4130 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:48.062513 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-67d8d941-f524-440a-9ae7-34194ffa4130 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:48.062966 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-67d8d941-f524-440a-9ae7-34194ffa4130 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:48.063734 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-67d8d941-f524-440a-9ae7-34194ffa4130 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:48.064172 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-67d8d941-f524-440a-9ae7-34194ffa4130 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:48.192611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-67d8d941-f524-440a-9ae7-34194ffa4130 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:48.200927 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-67d8d941-f524-440a-9ae7-34194ffa4130 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1735 microversion: 2.1 time: 0.149171 May 12 11:48:48.201490 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 260/528] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:48 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:49.218078 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-f54ce8d7-d7ad-4ac6-82e5-64e8e88d37e3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:49.218679 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-f54ce8d7-d7ad-4ac6-82e5-64e8e88d37e3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:49.225036 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f54ce8d7-d7ad-4ac6-82e5-64e8e88d37e3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:49.225490 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f54ce8d7-d7ad-4ac6-82e5-64e8e88d37e3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:49.226290 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f54ce8d7-d7ad-4ac6-82e5-64e8e88d37e3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:49.226732 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f54ce8d7-d7ad-4ac6-82e5-64e8e88d37e3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:49.349571 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-f54ce8d7-d7ad-4ac6-82e5-64e8e88d37e3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:49.357807 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-f54ce8d7-d7ad-4ac6-82e5-64e8e88d37e3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1735 microversion: 2.1 time: 0.143525 May 12 11:48:49.358377 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 269/529] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:49 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:50.374999 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-535e77e6-bf6d-4636-bb10-98b6c64b6a25 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:50.375626 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-535e77e6-bf6d-4636-bb10-98b6c64b6a25 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:50.381933 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-535e77e6-bf6d-4636-bb10-98b6c64b6a25 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:50.382382 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-535e77e6-bf6d-4636-bb10-98b6c64b6a25 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:50.383142 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-535e77e6-bf6d-4636-bb10-98b6c64b6a25 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:50.383578 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-535e77e6-bf6d-4636-bb10-98b6c64b6a25 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:50.507629 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-535e77e6-bf6d-4636-bb10-98b6c64b6a25 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:50.515344 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-535e77e6-bf6d-4636-bb10-98b6c64b6a25 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1735 microversion: 2.1 time: 0.144788 May 12 11:48:50.515912 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 261/530] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:50 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:51.531868 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-dc1e786a-918e-4c5c-86a1-a4dd2991a2c1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:51.532470 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-dc1e786a-918e-4c5c-86a1-a4dd2991a2c1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:51.538786 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dc1e786a-918e-4c5c-86a1-a4dd2991a2c1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:51.539233 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dc1e786a-918e-4c5c-86a1-a4dd2991a2c1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:51.539994 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dc1e786a-918e-4c5c-86a1-a4dd2991a2c1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:51.540426 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dc1e786a-918e-4c5c-86a1-a4dd2991a2c1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:51.668605 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-dc1e786a-918e-4c5c-86a1-a4dd2991a2c1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:51.676284 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-dc1e786a-918e-4c5c-86a1-a4dd2991a2c1 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1735 microversion: 2.1 time: 0.148188 May 12 11:48:51.676843 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 270/531] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:51 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:52.693151 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-aa421034-329b-454c-8abd-5d73893e30ed tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:52.693788 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-aa421034-329b-454c-8abd-5d73893e30ed tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:52.700665 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-aa421034-329b-454c-8abd-5d73893e30ed tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:52.701114 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-aa421034-329b-454c-8abd-5d73893e30ed tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:52.702172 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-aa421034-329b-454c-8abd-5d73893e30ed tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:52.702612 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-aa421034-329b-454c-8abd-5d73893e30ed tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:52.828143 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-aa421034-329b-454c-8abd-5d73893e30ed tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:52.835848 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-aa421034-329b-454c-8abd-5d73893e30ed tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1735 microversion: 2.1 time: 0.146504 May 12 11:48:52.836411 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 262/532] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:52 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:53.852595 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-3519e95d-8260-4fed-951a-0a59afac88ce tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:53.853151 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-3519e95d-8260-4fed-951a-0a59afac88ce tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:53.860009 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3519e95d-8260-4fed-951a-0a59afac88ce tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:53.860462 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3519e95d-8260-4fed-951a-0a59afac88ce tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:53.861224 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3519e95d-8260-4fed-951a-0a59afac88ce tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:53.861661 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3519e95d-8260-4fed-951a-0a59afac88ce tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:53.988335 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-3519e95d-8260-4fed-951a-0a59afac88ce tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:53.997387 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-3519e95d-8260-4fed-951a-0a59afac88ce tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1735 microversion: 2.1 time: 0.148537 May 12 11:48:53.998748 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 271/533] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:53 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:55.014088 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-636da14d-19b4-41d0-af8b-bbf87504304b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:55.014700 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-636da14d-19b4-41d0-af8b-bbf87504304b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:55.020831 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-636da14d-19b4-41d0-af8b-bbf87504304b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:55.021286 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-636da14d-19b4-41d0-af8b-bbf87504304b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:55.022099 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-636da14d-19b4-41d0-af8b-bbf87504304b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:55.022540 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-636da14d-19b4-41d0-af8b-bbf87504304b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:55.151955 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-636da14d-19b4-41d0-af8b-bbf87504304b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:55.159836 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-636da14d-19b4-41d0-af8b-bbf87504304b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1735 microversion: 2.1 time: 0.150198 May 12 11:48:55.160411 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 263/534] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:55 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:56.176390 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-f292c490-4c40-4a32-a103-b712467ef378 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:56.177006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-f292c490-4c40-4a32-a103-b712467ef378 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:56.183359 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f292c490-4c40-4a32-a103-b712467ef378 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:56.183814 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f292c490-4c40-4a32-a103-b712467ef378 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:56.184587 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f292c490-4c40-4a32-a103-b712467ef378 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:56.185032 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f292c490-4c40-4a32-a103-b712467ef378 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:56.312913 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-f292c490-4c40-4a32-a103-b712467ef378 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:56.321964 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-f292c490-4c40-4a32-a103-b712467ef378 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1735 microversion: 2.1 time: 0.149345 May 12 11:48:56.322537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 272/535] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:56 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:57.340644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-343f2751-acdd-41dd-9ef8-19d931ecacc7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:57.341257 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-343f2751-acdd-41dd-9ef8-19d931ecacc7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:57.347566 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-343f2751-acdd-41dd-9ef8-19d931ecacc7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:57.348016 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-343f2751-acdd-41dd-9ef8-19d931ecacc7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:57.348782 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-343f2751-acdd-41dd-9ef8-19d931ecacc7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:57.349217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-343f2751-acdd-41dd-9ef8-19d931ecacc7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:57.476349 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-343f2751-acdd-41dd-9ef8-19d931ecacc7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:57.484681 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-343f2751-acdd-41dd-9ef8-19d931ecacc7 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1735 microversion: 2.1 time: 0.148355 May 12 11:48:57.485256 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 264/536] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:57 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:58.502237 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-30b592d5-afa2-4538-8cfc-ab7ace36d73b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:58.502747 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-30b592d5-afa2-4538-8cfc-ab7ace36d73b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:58.511585 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-30b592d5-afa2-4538-8cfc-ab7ace36d73b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:58.512034 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-30b592d5-afa2-4538-8cfc-ab7ace36d73b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:58.512821 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-30b592d5-afa2-4538-8cfc-ab7ace36d73b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:58.513263 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-30b592d5-afa2-4538-8cfc-ab7ace36d73b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:58.642125 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-30b592d5-afa2-4538-8cfc-ab7ace36d73b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:58.649745 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-30b592d5-afa2-4538-8cfc-ab7ace36d73b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1735 microversion: 2.1 time: 0.151380 May 12 11:48:58.650317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 273/537] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:58 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:48:59.362416 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-8b10c6fd-aee3-4902-a0f6-9b767b9d69f4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:59.362915 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-8b10c6fd-aee3-4902-a0f6-9b767b9d69f4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:59.369180 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8b10c6fd-aee3-4902-a0f6-9b767b9d69f4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:59.369630 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8b10c6fd-aee3-4902-a0f6-9b767b9d69f4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:59.370437 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8b10c6fd-aee3-4902-a0f6-9b767b9d69f4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:59.370878 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8b10c6fd-aee3-4902-a0f6-9b767b9d69f4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:59.493414 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.objects.instance [None req-8b10c6fd-aee3-4902-a0f6-9b767b9d69f4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lazy-loading 'services' on Instance uuid a4394d3b-8300-4ce2-837d-65d1e01cc7c6 {{(pid=123507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:48:59.605294 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-8b10c6fd-aee3-4902-a0f6-9b767b9d69f4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6/os-volume_attachments/7a64e8b7-23ad-49e2-922e-db58d223daa6" status: 202 len: 0 microversion: 2.1 time: 0.246579 May 12 11:48:59.605923 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 265/538] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 12 11:48:59 2022] DELETE /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6/os-volume_attachments/7a64e8b7-23ad-49e2-922e-db58d223daa6 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:48:59.666138 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-2cbbcc91-ff44-4222-acd4-877687ea76af tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:48:59.666752 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-2cbbcc91-ff44-4222-acd4-877687ea76af tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:48:59.673803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2cbbcc91-ff44-4222-acd4-877687ea76af tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:59.674287 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2cbbcc91-ff44-4222-acd4-877687ea76af tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:59.675021 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2cbbcc91-ff44-4222-acd4-877687ea76af tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:48:59.675474 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2cbbcc91-ff44-4222-acd4-877687ea76af tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:48:59.799951 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-2cbbcc91-ff44-4222-acd4-877687ea76af tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:48:59.808172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-2cbbcc91-ff44-4222-acd4-877687ea76af tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1735 microversion: 2.1 time: 0.145854 May 12 11:48:59.808743 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 274/539] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:48:59 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:00.826666 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-687062c9-2f87-4d05-8e7b-8743c48f91a5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:00.827620 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-687062c9-2f87-4d05-8e7b-8743c48f91a5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:00.833850 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-687062c9-2f87-4d05-8e7b-8743c48f91a5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:00.834306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-687062c9-2f87-4d05-8e7b-8743c48f91a5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:00.835077 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-687062c9-2f87-4d05-8e7b-8743c48f91a5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:00.835677 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-687062c9-2f87-4d05-8e7b-8743c48f91a5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:00.960735 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-687062c9-2f87-4d05-8e7b-8743c48f91a5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:00.968283 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-687062c9-2f87-4d05-8e7b-8743c48f91a5 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1715 microversion: 2.1 time: 0.146843 May 12 11:49:00.968862 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 266/540] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:00 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1715 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:49:01.066875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-8f01bb1e-555a-4fda-9289-b05e9b045b99 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:01.067364 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-8f01bb1e-555a-4fda-9289-b05e9b045b99 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:01.073649 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8f01bb1e-555a-4fda-9289-b05e9b045b99 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:01.074133 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8f01bb1e-555a-4fda-9289-b05e9b045b99 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:01.074905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8f01bb1e-555a-4fda-9289-b05e9b045b99 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:01.075890 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8f01bb1e-555a-4fda-9289-b05e9b045b99 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:01.193872 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-8f01bb1e-555a-4fda-9289-b05e9b045b99 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] HTTP exception thrown: Cannot 'detach_volume' instance f609a10d-385a-4eb7-92b3-cfd766e53d22 while it is in vm_state rescued May 12 11:49:01.195480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-8f01bb1e-555a-4fda-9289-b05e9b045b99 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Request method failure captured: May 12 11:49:01.195480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: DELETE /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22/os-volume_attachments/244b7dcc-8b0f-4eed-b4fd-b340a1811947 HTTP/1.1 May 12 11:49:01.195480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:49:01.195480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:49:01.195480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:49:01.195480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:49:01.195480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:49:01.195480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:49:01.195480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:49:01.195480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:49:01.195480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPNGiEbPp1EKOPM8sNNzsWH98UxNn4UhORk8h08QbSY1P98NX0wWcAMF--kKN9Sfif9Yy8ydOqvtWecpYzdDjBj7nMFaod6Rdr76MtudieQbbdR4fJr20z_3SgdOIL7B907xiJQ5HNOYIzBktDwljSn0ORqCfq8kCZ8WTAtnO6fO0B4 May 12 11:49:01.195480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:49:01.195480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:49:01.195480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:49:01.195480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:49:01.195480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:49:01.195480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:49:01.195480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: dd154e9ddff14089b8fc96ba030e5669 May 12 11:49:01.195480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1383743525 May 12 11:49:01.195480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:49:01.195480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:49:01.197047 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd154e9ddff14089b8fc96ba030e5669"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd154e9ddff14089b8fc96ba030e5669"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd154e9ddff14089b8fc96ba030e5669"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd154e9ddff14089b8fc96ba030e5669", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:49:01.197047 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1383743525 May 12 11:49:01.197047 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: dd154e9ddff14089b8fc96ba030e5669 May 12 11:49:01.197047 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1383743525 May 12 11:49:01.197047 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-ServerRescueNegativeTestJSON-1383743525-project May 12 11:49:01.197047 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:49:01.197047 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:49:01.197047 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: af0e1282e6024c9c8f128a8d7b235733 May 12 11:49:01.197047 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1383743525-project May 12 11:49:01.197047 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:49:01.197047 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Cannot 'detach_volume' instance f609a10d-385a-4eb7-92b3-cfd766e53d22 while it is in vm_state rescued May 12 11:49:01.197730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'server_id': 'f609a10d-385a-4eb7-92b3-cfd766e53d22', 'id': '244b7dcc-8b0f-4eed-b4fd-b340a1811947'} May 12 11:49:01.197730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:49:01.197730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:49:01.197730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 11:49:01.197730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 11:49:01.197730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 11:49:01.197730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 11:49:01.197730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 12 11:49:01.197730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 12 11:49:01.197730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f609a10d-385a-4eb7-92b3-cfd766e53d22 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 12 11:49:01.197730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:49:01.197730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:49:01.197730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:49:01.197730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:49:01.197730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:49:01.197730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:49:01.197730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:49:01.197730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:49:01.197730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:49:01.197730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:49:01.199044 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 12 11:49:01.199044 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 12 11:49:01.199044 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 12 11:49:01.199044 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 12 11:49:01.199044 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f609a10d-385a-4eb7-92b3-cfd766e53d22 while it is in vm_state rescued May 12 11:49:01.199044 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:49:01.199044 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:49:01.199044 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:49:01.199044 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:49:01.199044 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:49:01.199044 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:49:01.199044 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:49:01.199044 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:49:01.199044 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f609a10d-385a-4eb7-92b3-cfd766e53d22 while it is in vm_state rescued May 12 11:49:01.199044 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:49:01.199044 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-8f01bb1e-555a-4fda-9289-b05e9b045b99 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Returning 409 to user: Cannot 'detach_volume' instance f609a10d-385a-4eb7-92b3-cfd766e53d22 while it is in vm_state rescued {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:49:01.200698 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-8f01bb1e-555a-4fda-9289-b05e9b045b99 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22/os-volume_attachments/244b7dcc-8b0f-4eed-b4fd-b340a1811947" status: 409 len: 152 microversion: 2.1 time: 0.133950 May 12 11:49:01.200698 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 275/541] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 12 11:49:01 2022] DELETE /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22/os-volume_attachments/244b7dcc-8b0f-4eed-b4fd-b340a1811947 => generated 152 bytes in 135 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 12 11:49:01.206490 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-94506083-8ba9-4cba-ae05-3c8253593efd tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:49:01.207019 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-94506083-8ba9-4cba-ae05-3c8253593efd tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:01.212774 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-94506083-8ba9-4cba-ae05-3c8253593efd tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:01.213248 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-94506083-8ba9-4cba-ae05-3c8253593efd tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:01.214032 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-94506083-8ba9-4cba-ae05-3c8253593efd tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:01.214472 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-94506083-8ba9-4cba-ae05-3c8253593efd tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:01.275747 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-94506083-8ba9-4cba-ae05-3c8253593efd tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "POST /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22/action" status: 202 len: 0 microversion: 2.1 time: 0.072840 May 12 11:49:01.276529 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 267/542] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 12 11:49:01 2022] POST /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:49:01.287428 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-45fd5697-89e8-4f51-bdc0-c11410da19bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:01.288074 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-45fd5697-89e8-4f51-bdc0-c11410da19bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:01.294434 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-45fd5697-89e8-4f51-bdc0-c11410da19bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:01.294885 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-45fd5697-89e8-4f51-bdc0-c11410da19bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:01.295650 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-45fd5697-89e8-4f51-bdc0-c11410da19bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:01.296092 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-45fd5697-89e8-4f51-bdc0-c11410da19bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:01.427797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-45fd5697-89e8-4f51-bdc0-c11410da19bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:01.436357 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-45fd5697-89e8-4f51-bdc0-c11410da19bb tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1723 microversion: 2.1 time: 0.155672 May 12 11:49:01.436940 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 276/543] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:01 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:02.455582 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-8af3d7e1-5952-4805-8b77-3361f5c1f1f2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:02.456273 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-8af3d7e1-5952-4805-8b77-3361f5c1f1f2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:02.462491 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8af3d7e1-5952-4805-8b77-3361f5c1f1f2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:02.462932 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8af3d7e1-5952-4805-8b77-3361f5c1f1f2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:02.463692 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8af3d7e1-5952-4805-8b77-3361f5c1f1f2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:02.464127 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8af3d7e1-5952-4805-8b77-3361f5c1f1f2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:02.588843 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-8af3d7e1-5952-4805-8b77-3361f5c1f1f2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:02.596672 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-8af3d7e1-5952-4805-8b77-3361f5c1f1f2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1723 microversion: 2.1 time: 0.146671 May 12 11:49:02.597233 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 268/544] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:02 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:02.829590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-d5bbee7c-e4aa-4306-bfb9-f2e74e661939 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:02.830120 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d5bbee7c-e4aa-4306-bfb9-f2e74e661939 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:02.836403 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d5bbee7c-e4aa-4306-bfb9-f2e74e661939 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:02.836856 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d5bbee7c-e4aa-4306-bfb9-f2e74e661939 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:02.837629 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d5bbee7c-e4aa-4306-bfb9-f2e74e661939 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:02.838096 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d5bbee7c-e4aa-4306-bfb9-f2e74e661939 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:02.862892 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d5bbee7c-e4aa-4306-bfb9-f2e74e661939 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Going to try to terminate instance {{(pid=123508) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 11:49:02.933145 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-d5bbee7c-e4aa-4306-bfb9-f2e74e661939 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6" status: 204 len: 0 microversion: 2.1 time: 0.107866 May 12 11:49:02.933738 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 277/545] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:49:02 2022] DELETE /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 11:49:02.941981 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-44c18970-8f08-446d-94ac-df20b9fdf056 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:02.942581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-44c18970-8f08-446d-94ac-df20b9fdf056 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:02.948339 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-44c18970-8f08-446d-94ac-df20b9fdf056 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:02.948779 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-44c18970-8f08-446d-94ac-df20b9fdf056 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:02.949525 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-44c18970-8f08-446d-94ac-df20b9fdf056 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:02.950498 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-44c18970-8f08-446d-94ac-df20b9fdf056 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:03.084076 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-44c18970-8f08-446d-94ac-df20b9fdf056 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:03.091799 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-44c18970-8f08-446d-94ac-df20b9fdf056 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6" status: 200 len: 1514 microversion: 2.1 time: 0.153843 May 12 11:49:03.092356 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 269/546] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:02 2022] GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:03.613943 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-8b6ba6e9-d575-4fdf-a226-653fbfa208f2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:03.614645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-8b6ba6e9-d575-4fdf-a226-653fbfa208f2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:03.620503 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8b6ba6e9-d575-4fdf-a226-653fbfa208f2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:03.620957 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8b6ba6e9-d575-4fdf-a226-653fbfa208f2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:03.621740 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8b6ba6e9-d575-4fdf-a226-653fbfa208f2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:03.622796 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8b6ba6e9-d575-4fdf-a226-653fbfa208f2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:03.746043 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8b6ba6e9-d575-4fdf-a226-653fbfa208f2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:03.753844 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-8b6ba6e9-d575-4fdf-a226-653fbfa208f2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1723 microversion: 2.1 time: 0.144110 May 12 11:49:03.754385 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 278/547] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:03 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:04.108819 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-e97b2cd1-9062-4fa7-98f0-0589ac726731 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:04.109431 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-e97b2cd1-9062-4fa7-98f0-0589ac726731 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:04.115795 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e97b2cd1-9062-4fa7-98f0-0589ac726731 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:04.116238 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e97b2cd1-9062-4fa7-98f0-0589ac726731 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:04.116998 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e97b2cd1-9062-4fa7-98f0-0589ac726731 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:04.117431 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e97b2cd1-9062-4fa7-98f0-0589ac726731 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:04.241063 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-e97b2cd1-9062-4fa7-98f0-0589ac726731 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:04.248782 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-e97b2cd1-9062-4fa7-98f0-0589ac726731 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6" status: 200 len: 1514 microversion: 2.1 time: 0.143942 May 12 11:49:04.249338 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 270/548] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:04 2022] GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6 => generated 1514 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:04.771335 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b194d2c8-e2fb-410d-9b90-91c515778d4e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:04.771872 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-b194d2c8-e2fb-410d-9b90-91c515778d4e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:04.778706 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b194d2c8-e2fb-410d-9b90-91c515778d4e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:04.779158 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b194d2c8-e2fb-410d-9b90-91c515778d4e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:04.779920 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b194d2c8-e2fb-410d-9b90-91c515778d4e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:04.780361 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b194d2c8-e2fb-410d-9b90-91c515778d4e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:04.907698 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b194d2c8-e2fb-410d-9b90-91c515778d4e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:04.915347 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-b194d2c8-e2fb-410d-9b90-91c515778d4e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1723 microversion: 2.1 time: 0.147952 May 12 11:49:04.915909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 279/549] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:04 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:05.229357 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-a98e910d-2778-4a9d-8400-2b726d0c540e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:05.229912 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-a98e910d-2778-4a9d-8400-2b726d0c540e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:05.236069 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a98e910d-2778-4a9d-8400-2b726d0c540e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:05.236520 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a98e910d-2778-4a9d-8400-2b726d0c540e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:05.237278 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a98e910d-2778-4a9d-8400-2b726d0c540e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:05.237729 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a98e910d-2778-4a9d-8400-2b726d0c540e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:05.266390 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-7ab4f188-db54-487a-ab07-0fb569d2f5ae tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:05.267124 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-7ab4f188-db54-487a-ab07-0fb569d2f5ae tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:05.273369 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7ab4f188-db54-487a-ab07-0fb569d2f5ae tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:05.273927 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7ab4f188-db54-487a-ab07-0fb569d2f5ae tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:05.274765 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7ab4f188-db54-487a-ab07-0fb569d2f5ae tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:05.275273 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7ab4f188-db54-487a-ab07-0fb569d2f5ae tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:05.314464 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.objects.instance [None req-a98e910d-2778-4a9d-8400-2b726d0c540e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lazy-loading 'services' on Instance uuid 6bf4fa9e-950e-4be3-b042-517c2079c0f2 {{(pid=123507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:49:05.386685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-a98e910d-2778-4a9d-8400-2b726d0c540e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2/os-volume_attachments/98129c23-04ca-4621-8558-bd0bcae0259f" status: 202 len: 0 microversion: 2.1 time: 0.161084 May 12 11:49:05.387961 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 271/550] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 12 11:49:05 2022] DELETE /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2/os-volume_attachments/98129c23-04ca-4621-8558-bd0bcae0259f => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:49:05.414468 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-7ab4f188-db54-487a-ab07-0fb569d2f5ae tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:05.422326 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-7ab4f188-db54-487a-ab07-0fb569d2f5ae tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6" status: 200 len: 1514 microversion: 2.1 time: 0.160125 May 12 11:49:05.422920 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 280/551] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:05 2022] GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:49:05.934476 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-249d2774-f762-4b25-a531-b19857b51091 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:05.935918 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-249d2774-f762-4b25-a531-b19857b51091 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:05.943456 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-249d2774-f762-4b25-a531-b19857b51091 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:05.943910 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-249d2774-f762-4b25-a531-b19857b51091 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:05.944694 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-249d2774-f762-4b25-a531-b19857b51091 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:05.945136 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-249d2774-f762-4b25-a531-b19857b51091 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:06.074266 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-249d2774-f762-4b25-a531-b19857b51091 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:06.082167 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-249d2774-f762-4b25-a531-b19857b51091 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1723 microversion: 2.1 time: 0.153225 May 12 11:49:06.082738 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 272/552] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:05 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:06.439429 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-4481d098-1ae6-4e42-9a31-0f56474c59e9 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:06.440096 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-4481d098-1ae6-4e42-9a31-0f56474c59e9 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:06.454759 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4481d098-1ae6-4e42-9a31-0f56474c59e9 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:06.454759 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4481d098-1ae6-4e42-9a31-0f56474c59e9 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:06.455101 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4481d098-1ae6-4e42-9a31-0f56474c59e9 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:06.455365 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4481d098-1ae6-4e42-9a31-0f56474c59e9 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:06.584777 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-4481d098-1ae6-4e42-9a31-0f56474c59e9 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:06.592568 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-4481d098-1ae6-4e42-9a31-0f56474c59e9 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6" status: 200 len: 1514 microversion: 2.1 time: 0.157130 May 12 11:49:06.593136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 281/553] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:06 2022] GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:07.099276 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-413e8ccd-7d45-48fa-ba10-aefceab99654 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:07.099792 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-413e8ccd-7d45-48fa-ba10-aefceab99654 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:07.106192 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-413e8ccd-7d45-48fa-ba10-aefceab99654 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:07.107317 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-413e8ccd-7d45-48fa-ba10-aefceab99654 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:07.108092 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-413e8ccd-7d45-48fa-ba10-aefceab99654 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:07.108530 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-413e8ccd-7d45-48fa-ba10-aefceab99654 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:07.235622 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-413e8ccd-7d45-48fa-ba10-aefceab99654 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:07.243296 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-413e8ccd-7d45-48fa-ba10-aefceab99654 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1729 microversion: 2.1 time: 0.147982 May 12 11:49:07.243867 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 273/554] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:07 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1729 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:07.259593 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-de9c33e5-c7c5-4ee2-83e9-f058236b0ac8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:07.260085 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-de9c33e5-c7c5-4ee2-83e9-f058236b0ac8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:07.265856 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-de9c33e5-c7c5-4ee2-83e9-f058236b0ac8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:07.266305 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-de9c33e5-c7c5-4ee2-83e9-f058236b0ac8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:07.267066 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-de9c33e5-c7c5-4ee2-83e9-f058236b0ac8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:07.267504 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-de9c33e5-c7c5-4ee2-83e9-f058236b0ac8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:07.352929 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-de9c33e5-c7c5-4ee2-83e9-f058236b0ac8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092883 May 12 11:49:07.353470 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 282/555] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 12 11:49:07 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:49:07.609954 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-b18b9223-8292-4846-81a1-956735aaa1af tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:07.610493 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-b18b9223-8292-4846-81a1-956735aaa1af tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:07.616338 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b18b9223-8292-4846-81a1-956735aaa1af tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:07.616784 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b18b9223-8292-4846-81a1-956735aaa1af tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:07.617547 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b18b9223-8292-4846-81a1-956735aaa1af tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:07.618016 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b18b9223-8292-4846-81a1-956735aaa1af tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:07.755897 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b18b9223-8292-4846-81a1-956735aaa1af tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:07.763811 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-b18b9223-8292-4846-81a1-956735aaa1af tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6" status: 200 len: 1514 microversion: 2.1 time: 0.158340 May 12 11:49:07.764426 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 274/556] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:07 2022] GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:08.613404 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-571da7db-195d-4d03-8a48-cdf559a5bb58 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:49:08.619279 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-571da7db-195d-4d03-8a48-cdf559a5bb58 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:08.619736 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-571da7db-195d-4d03-8a48-cdf559a5bb58 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:08.682197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-571da7db-195d-4d03-8a48-cdf559a5bb58 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Going to try to stop instance {{(pid=123508) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 12 11:49:08.728626 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-571da7db-195d-4d03-8a48-cdf559a5bb58 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "POST /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2/action" status: 202 len: 0 microversion: 2.1 time: 0.119301 May 12 11:49:08.733385 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 283/557] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 12 11:49:08 2022] POST /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:49:08.739550 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-35fdeb2b-0391-451b-bdd6-7d551573c0ef tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:08.740859 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-35fdeb2b-0391-451b-bdd6-7d551573c0ef tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:08.747841 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-35fdeb2b-0391-451b-bdd6-7d551573c0ef tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:08.749007 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-35fdeb2b-0391-451b-bdd6-7d551573c0ef tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:08.750404 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-35fdeb2b-0391-451b-bdd6-7d551573c0ef tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:08.750651 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-35fdeb2b-0391-451b-bdd6-7d551573c0ef tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:08.781545 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ae5563b5-34f1-48b2-b6ff-db326862b810 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:08.782523 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-ae5563b5-34f1-48b2-b6ff-db326862b810 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:08.789308 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ae5563b5-34f1-48b2-b6ff-db326862b810 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:08.789897 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ae5563b5-34f1-48b2-b6ff-db326862b810 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:08.790780 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ae5563b5-34f1-48b2-b6ff-db326862b810 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:08.791262 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ae5563b5-34f1-48b2-b6ff-db326862b810 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:08.896668 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-35fdeb2b-0391-451b-bdd6-7d551573c0ef tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:08.905628 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-35fdeb2b-0391-451b-bdd6-7d551573c0ef tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1676 microversion: 2.1 time: 0.171037 May 12 11:49:08.915301 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 275/558] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:08 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:08.915642 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-ae5563b5-34f1-48b2-b6ff-db326862b810 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:08.915752 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-3f2f3fcc-137c-45f2-b218-3b4cdcf5a282 req-3ba9c9ba-8112-4d2e-b117-8f75a8e45832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4394d3b-8300-4ce2-837d-65d1e01cc7c6", "name": "network-vif-deleted", "tag": "7d624a29-c293-4840-b98d-df28f56aaff7"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:49:08.915853 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-ae5563b5-34f1-48b2-b6ff-db326862b810 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6" status: 200 len: 1472 microversion: 2.1 time: 0.139110 May 12 11:49:08.922418 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-3f2f3fcc-137c-45f2-b218-3b4cdcf5a282 req-3ba9c9ba-8112-4d2e-b117-8f75a8e45832 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:08.922867 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-3f2f3fcc-137c-45f2-b218-3b4cdcf5a282 req-3ba9c9ba-8112-4d2e-b117-8f75a8e45832 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:08.926879 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 284/559] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:08 2022] GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6 => generated 1472 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:49:08.934388 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-3f2f3fcc-137c-45f2-b218-3b4cdcf5a282 req-3ba9c9ba-8112-4d2e-b117-8f75a8e45832 service nova] Creating event network-vif-deleted:7d624a29-c293-4840-b98d-df28f56aaff7 for instance a4394d3b-8300-4ce2-837d-65d1e01cc7c6 on hv-cinder-80473 May 12 11:49:08.939821 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-3f2f3fcc-137c-45f2-b218-3b4cdcf5a282 req-3ba9c9ba-8112-4d2e-b117-8f75a8e45832 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032282 May 12 11:49:08.941061 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 276/560] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:49:09.922675 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-0f1d2644-073f-4ba3-8411-b48051941790 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:09.923290 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-0f1d2644-073f-4ba3-8411-b48051941790 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:09.929786 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0f1d2644-073f-4ba3-8411-b48051941790 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:09.930242 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0f1d2644-073f-4ba3-8411-b48051941790 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:09.931015 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0f1d2644-073f-4ba3-8411-b48051941790 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:09.931461 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0f1d2644-073f-4ba3-8411-b48051941790 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:09.933099 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-7162d00d-0894-4d07-bad9-dd835ad6fac7 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:09.933852 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-7162d00d-0894-4d07-bad9-dd835ad6fac7 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: a4394d3b-8300-4ce2-837d-65d1e01cc7c6] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:09.940431 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7162d00d-0894-4d07-bad9-dd835ad6fac7 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:09.940876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7162d00d-0894-4d07-bad9-dd835ad6fac7 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:09.941642 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7162d00d-0894-4d07-bad9-dd835ad6fac7 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:09.942106 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7162d00d-0894-4d07-bad9-dd835ad6fac7 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:09.955577 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-7162d00d-0894-4d07-bad9-dd835ad6fac7 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] HTTP exception thrown: Instance a4394d3b-8300-4ce2-837d-65d1e01cc7c6 could not be found. May 12 11:49:09.957215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-7162d00d-0894-4d07-bad9-dd835ad6fac7 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Request method failure captured: May 12 11:49:09.957215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6 HTTP/1.1 May 12 11:49:09.957215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:49:09.957215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:49:09.957215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:49:09.957215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 0 May 12 11:49:09.957215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:49:09.957215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:49:09.957215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:49:09.957215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:49:09.957215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPPvcBhjWlgLJqIOp1s-LjtK_e-kc6pKGiVccON4-4N352FFVQjAKs8WHm89rNn1K3VAgIlE-pFfjGTchxme1jugTje0L3GwjVgXt9pNZVrks-kUgWaJ1ML4MqvvHSKbobu9mnNbrBkh1Xh_GLEmHX4kvNge98owQMWcaDk4Fk2neaI May 12 11:49:09.957215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:49:09.957215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:49:09.957215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:49:09.957215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:49:09.957215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:49:09.957215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:49:09.957215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: 7a1abe690e43433daccff30391d4b260 May 12 11:49:09.957215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1205523019 May 12 11:49:09.957215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:49:09.957215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:49:09.958741 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7a1abe690e43433daccff30391d4b260"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7a1abe690e43433daccff30391d4b260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7a1abe690e43433daccff30391d4b260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7a1abe690e43433daccff30391d4b260", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:49:09.958741 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-VolumesSnapshotTestJSON-1205523019 May 12 11:49:09.958741 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: 7a1abe690e43433daccff30391d4b260 May 12 11:49:09.958741 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1205523019 May 12 11:49:09.958741 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-VolumesSnapshotTestJSON-1205523019-project May 12 11:49:09.958741 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:49:09.958741 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:49:09.958741 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: 70abbcb3651945609f0e65237135f3e7 May 12 11:49:09.958741 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-VolumesSnapshotTestJSON-1205523019-project May 12 11:49:09.958741 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: > May 12 11:49:09.958741 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Instance a4394d3b-8300-4ce2-837d-65d1e01cc7c6 could not be found. May 12 11:49:09.958741 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'id': 'a4394d3b-8300-4ce2-837d-65d1e01cc7c6'} May 12 11:49:09.959644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:49:09.959644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:49:09.959644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:49:09.959644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:49:09.959644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:49:09.959644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:49:09.959644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:49:09.959644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:49:09.959644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:49:09.959644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:49:09.959644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4394d3b-8300-4ce2-837d-65d1e01cc7c6 could not be found. May 12 11:49:09.959644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:49:09.959644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:49:09.959644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:49:09.959644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:49:09.959644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:49:09.959644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:49:09.959644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:49:09.959644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:49:09.959644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:49:09.961030 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:49:09.961030 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:49:09.961030 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:49:09.961030 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:49:09.961030 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:49:09.961030 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:49:09.961030 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:49:09.961030 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4394d3b-8300-4ce2-837d-65d1e01cc7c6 could not be found. May 12 11:49:09.961030 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:49:09.961030 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:49:09.961030 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:49:09.961030 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:49:09.961030 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:49:09.961030 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:49:09.961030 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:49:09.961030 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:49:09.961030 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4394d3b-8300-4ce2-837d-65d1e01cc7c6 could not be found. May 12 11:49:09.961030 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:49:09.962321 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-7162d00d-0894-4d07-bad9-dd835ad6fac7 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Returning 404 to user: Instance a4394d3b-8300-4ce2-837d-65d1e01cc7c6 could not be found. {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:49:09.962321 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-7162d00d-0894-4d07-bad9-dd835ad6fac7 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6" status: 404 len: 111 microversion: 2.1 time: 0.030145 May 12 11:49:09.962321 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 277/561] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:09 2022] GET /compute/v2.1/servers/a4394d3b-8300-4ce2-837d-65d1e01cc7c6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 11:49:10.063479 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-0f1d2644-073f-4ba3-8411-b48051941790 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:10.072221 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-0f1d2644-073f-4ba3-8411-b48051941790 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1676 microversion: 2.1 time: 0.153904 May 12 11:49:10.072979 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 285/562] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:09 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:10.955256 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-831a28c5-13e4-44cc-9f49-4743c257e001 req-3eba1ade-8083-4a2a-8847-9b1846850d51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f609a10d-385a-4eb7-92b3-cfd766e53d22", "tag": "2eb78bc7-7875-449d-a6e9-a6f8eebe488c"}, {"name": "network-changed", "server_uuid": "f609a10d-385a-4eb7-92b3-cfd766e53d22", "tag": "2eb78bc7-7875-449d-a6e9-a6f8eebe488c"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:49:10.963563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-831a28c5-13e4-44cc-9f49-4743c257e001 req-3eba1ade-8083-4a2a-8847-9b1846850d51 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:10.964008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-831a28c5-13e4-44cc-9f49-4743c257e001 req-3eba1ade-8083-4a2a-8847-9b1846850d51 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:10.974637 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-831a28c5-13e4-44cc-9f49-4743c257e001 req-3eba1ade-8083-4a2a-8847-9b1846850d51 service nova] Creating event network-changed:2eb78bc7-7875-449d-a6e9-a6f8eebe488c for instance f609a10d-385a-4eb7-92b3-cfd766e53d22 on hv-cinder-80473 May 12 11:49:10.975151 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-831a28c5-13e4-44cc-9f49-4743c257e001 req-3eba1ade-8083-4a2a-8847-9b1846850d51 service nova] Creating event network-changed:2eb78bc7-7875-449d-a6e9-a6f8eebe488c for instance f609a10d-385a-4eb7-92b3-cfd766e53d22 on hv-cinder-80473 May 12 11:49:10.980198 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-831a28c5-13e4-44cc-9f49-4743c257e001 req-3eba1ade-8083-4a2a-8847-9b1846850d51 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.029476 May 12 11:49:10.980758 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 278/563] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:49:11.090089 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-fc040d2d-1713-4516-be72-811004feee26 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:11.090702 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-fc040d2d-1713-4516-be72-811004feee26 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:11.096976 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fc040d2d-1713-4516-be72-811004feee26 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:11.097438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fc040d2d-1713-4516-be72-811004feee26 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:11.098235 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fc040d2d-1713-4516-be72-811004feee26 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:11.098676 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fc040d2d-1713-4516-be72-811004feee26 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:11.232248 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-fc040d2d-1713-4516-be72-811004feee26 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:11.239478 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-fc040d2d-1713-4516-be72-811004feee26 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1676 microversion: 2.1 time: 0.153258 May 12 11:49:11.240061 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 286/564] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:11 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:12.257280 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-d943dcee-93ca-4a32-9ee2-79f77b613267 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:12.257999 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d943dcee-93ca-4a32-9ee2-79f77b613267 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:12.264420 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d943dcee-93ca-4a32-9ee2-79f77b613267 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:12.264859 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d943dcee-93ca-4a32-9ee2-79f77b613267 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:12.265613 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d943dcee-93ca-4a32-9ee2-79f77b613267 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:12.266069 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d943dcee-93ca-4a32-9ee2-79f77b613267 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:12.389210 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-d943dcee-93ca-4a32-9ee2-79f77b613267 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:12.396323 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-d943dcee-93ca-4a32-9ee2-79f77b613267 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1676 microversion: 2.1 time: 0.143203 May 12 11:49:12.396875 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 279/565] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:12 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1676 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:13.413630 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-be446e57-1f57-42be-97b9-2c336a803a64 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:13.414282 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-be446e57-1f57-42be-97b9-2c336a803a64 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:13.421185 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-be446e57-1f57-42be-97b9-2c336a803a64 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:13.421738 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-be446e57-1f57-42be-97b9-2c336a803a64 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:13.422710 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-be446e57-1f57-42be-97b9-2c336a803a64 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:13.423157 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-be446e57-1f57-42be-97b9-2c336a803a64 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:13.600466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-be446e57-1f57-42be-97b9-2c336a803a64 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:13.607871 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-be446e57-1f57-42be-97b9-2c336a803a64 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1676 microversion: 2.1 time: 0.198053 May 12 11:49:13.608642 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 287/566] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:13 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1676 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:14.624846 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-b3fbc7e5-2abf-41a4-9670-7ade98d36065 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:14.625454 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-b3fbc7e5-2abf-41a4-9670-7ade98d36065 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:14.631713 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b3fbc7e5-2abf-41a4-9670-7ade98d36065 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:14.632161 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b3fbc7e5-2abf-41a4-9670-7ade98d36065 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:14.632924 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b3fbc7e5-2abf-41a4-9670-7ade98d36065 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:14.633361 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b3fbc7e5-2abf-41a4-9670-7ade98d36065 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:14.765465 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b3fbc7e5-2abf-41a4-9670-7ade98d36065 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:14.772831 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-b3fbc7e5-2abf-41a4-9670-7ade98d36065 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1676 microversion: 2.1 time: 0.152464 May 12 11:49:14.773570 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 280/567] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:14 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:15.789381 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-bde79e79-32c4-4d2a-b13b-d35f01c0ddb0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:15.789922 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-bde79e79-32c4-4d2a-b13b-d35f01c0ddb0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:15.796835 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bde79e79-32c4-4d2a-b13b-d35f01c0ddb0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:15.797287 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bde79e79-32c4-4d2a-b13b-d35f01c0ddb0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:15.798101 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bde79e79-32c4-4d2a-b13b-d35f01c0ddb0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:15.798541 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bde79e79-32c4-4d2a-b13b-d35f01c0ddb0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:15.926355 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-bde79e79-32c4-4d2a-b13b-d35f01c0ddb0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:15.933536 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-bde79e79-32c4-4d2a-b13b-d35f01c0ddb0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1676 microversion: 2.1 time: 0.148083 May 12 11:49:15.934146 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 288/568] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:15 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:16.951539 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-f07c5e8a-f94b-4f49-ad26-4e3e76355249 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:16.952096 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-f07c5e8a-f94b-4f49-ad26-4e3e76355249 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:16.958639 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f07c5e8a-f94b-4f49-ad26-4e3e76355249 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:16.959084 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f07c5e8a-f94b-4f49-ad26-4e3e76355249 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:16.959840 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f07c5e8a-f94b-4f49-ad26-4e3e76355249 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:16.960268 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f07c5e8a-f94b-4f49-ad26-4e3e76355249 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:17.089021 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-f07c5e8a-f94b-4f49-ad26-4e3e76355249 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:17.098522 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-f07c5e8a-f94b-4f49-ad26-4e3e76355249 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1676 microversion: 2.1 time: 0.151150 May 12 11:49:17.099094 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 281/569] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:16 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:17.597308 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-c7608cbf-5eec-4667-a4ce-a2ec37942eb0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:17.597837 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-c7608cbf-5eec-4667-a4ce-a2ec37942eb0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:17.604074 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c7608cbf-5eec-4667-a4ce-a2ec37942eb0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:17.604519 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c7608cbf-5eec-4667-a4ce-a2ec37942eb0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:17.605276 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c7608cbf-5eec-4667-a4ce-a2ec37942eb0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:17.605735 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c7608cbf-5eec-4667-a4ce-a2ec37942eb0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:17.633049 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-c7608cbf-5eec-4667-a4ce-a2ec37942eb0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916/os-volume_attachments/6cd26e9d-5e55-48fb-b565-9746c7066b18" status: 200 len: 194 microversion: 2.20 time: 0.039703 May 12 11:49:17.633619 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 289/570] 10.222.0.58 () {60 vars in 1453 bytes} [Thu May 12 11:49:17 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916/os-volume_attachments/6cd26e9d-5e55-48fb-b565-9746c7066b18 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 11:49:17.695385 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-85464fdc-490d-4852-9d3f-d1159f4ab920 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:17.696004 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-85464fdc-490d-4852-9d3f-d1159f4ab920 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:17.699450 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-8d87e7ed-8375-4314-bd21-069413bc6e8a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-300142830", "imageRef": "576e8b7b-771b-47aa-89c6-ff04accc9bea", "flavorRef": "452", "networks": [{"uuid": "acb61e6d-7b7b-4a9a-bc49-033a539945dd"}]}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:49:17.703204 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-85464fdc-490d-4852-9d3f-d1159f4ab920 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:17.703653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-85464fdc-490d-4852-9d3f-d1159f4ab920 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:17.704428 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-85464fdc-490d-4852-9d3f-d1159f4ab920 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:17.704866 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-85464fdc-490d-4852-9d3f-d1159f4ab920 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:17.751069 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.network.neutron [None req-8d87e7ed-8375-4314-bd21-069413bc6e8a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] validate_networks() for [('acb61e6d-7b7b-4a9a-bc49-033a539945dd', None, None, None, None, None)] {{(pid=123508) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 11:49:17.783389 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.objects.instance [None req-85464fdc-490d-4852-9d3f-d1159f4ab920 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lazy-loading 'services' on Instance uuid c5cd2aad-2374-4ded-8b72-2e54fbbad916 {{(pid=123507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:49:17.853253 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-85464fdc-490d-4852-9d3f-d1159f4ab920 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916/os-volume_attachments/6cd26e9d-5e55-48fb-b565-9746c7066b18" status: 202 len: 0 microversion: 2.20 time: 0.161620 May 12 11:49:17.853879 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 282/571] 10.222.0.58 () {60 vars in 1456 bytes} [Thu May 12 11:49:17 2022] DELETE /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916/os-volume_attachments/6cd26e9d-5e55-48fb-b565-9746c7066b18 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 11:49:17.863368 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-e0e1fa3e-07c7-494f-bf85-04ae787b38e1 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:17.864368 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-e0e1fa3e-07c7-494f-bf85-04ae787b38e1 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:17.870658 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e0e1fa3e-07c7-494f-bf85-04ae787b38e1 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:17.871986 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e0e1fa3e-07c7-494f-bf85-04ae787b38e1 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:17.873915 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e0e1fa3e-07c7-494f-bf85-04ae787b38e1 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:17.874354 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e0e1fa3e-07c7-494f-bf85-04ae787b38e1 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:17.908997 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-e0e1fa3e-07c7-494f-bf85-04ae787b38e1 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049208 May 12 11:49:17.909569 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 283/572] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 12 11:49:17 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 11:49:18.091908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-8d87e7ed-8375-4314-bd21-069413bc6e8a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Flavor limits 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 11:49:18.092330 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-8d87e7ed-8375-4314-bd21-069413bc6e8a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Image limits 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 11:49:18.092831 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-8d87e7ed-8375-4314-bd21-069413bc6e8a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Flavor pref 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 11:49:18.093242 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-8d87e7ed-8375-4314-bd21-069413bc6e8a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Image pref 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 11:49:18.093684 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-8d87e7ed-8375-4314-bd21-069413bc6e8a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 11:49:18.102907 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8d87e7ed-8375-4314-bd21-069413bc6e8a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:18.103357 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8d87e7ed-8375-4314-bd21-069413bc6e8a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:18.104161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8d87e7ed-8375-4314-bd21-069413bc6e8a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:18.104601 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8d87e7ed-8375-4314-bd21-069413bc6e8a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:18.115617 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-eacc5eda-18e7-46cc-9ef2-0e502c38a434 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:18.116234 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-eacc5eda-18e7-46cc-9ef2-0e502c38a434 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:18.121183 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-8d87e7ed-8375-4314-bd21-069413bc6e8a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Getting quotas for project 7a1abe690e43433daccff30391d4b260. Resources: {'ram', 'cores', 'instances'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:49:18.123058 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-eacc5eda-18e7-46cc-9ef2-0e502c38a434 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:18.123502 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-eacc5eda-18e7-46cc-9ef2-0e502c38a434 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:18.124259 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-eacc5eda-18e7-46cc-9ef2-0e502c38a434 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:18.124691 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-eacc5eda-18e7-46cc-9ef2-0e502c38a434 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:18.125832 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-8d87e7ed-8375-4314-bd21-069413bc6e8a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Getting quotas for user 70abbcb3651945609f0e65237135f3e7 and project 7a1abe690e43433daccff30391d4b260. Resources: {'ram', 'cores', 'instances'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:49:18.136481 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-8d87e7ed-8375-4314-bd21-069413bc6e8a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Going to run 1 instances... {{(pid=123508) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 11:49:18.138772 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-8d87e7ed-8375-4314-bd21-069413bc6e8a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: ba6039b3-958e-46ef-83e3-a942c113b22a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='576e8b7b-771b-47aa-89c6-ff04accc9bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 11:49:18.181903 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-8d87e7ed-8375-4314-bd21-069413bc6e8a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.486083 May 12 11:49:18.182716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 290/573] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 12 11:49:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 11:49:18.192852 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-34fa341a-ff1b-47af-bf2a-b10464e06c9b tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:18.193464 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-34fa341a-ff1b-47af-bf2a-b10464e06c9b tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: ba6039b3-958e-46ef-83e3-a942c113b22a] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:18.247753 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-34fa341a-ff1b-47af-bf2a-b10464e06c9b tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:18.254900 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-34fa341a-ff1b-47af-bf2a-b10464e06c9b tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a" status: 200 len: 1218 microversion: 2.1 time: 0.065741 May 12 11:49:18.255471 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 291/574] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:18 2022] GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:49:18.261200 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-eacc5eda-18e7-46cc-9ef2-0e502c38a434 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:18.269617 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-eacc5eda-18e7-46cc-9ef2-0e502c38a434 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1676 microversion: 2.1 time: 0.157728 May 12 11:49:18.270168 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 284/575] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:18 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:49:18.921428 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a74e702a-65b9-4486-8a8c-4ffb7f58d06f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:18.922434 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-a74e702a-65b9-4486-8a8c-4ffb7f58d06f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:18.929308 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a74e702a-65b9-4486-8a8c-4ffb7f58d06f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:18.929789 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a74e702a-65b9-4486-8a8c-4ffb7f58d06f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:18.930692 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a74e702a-65b9-4486-8a8c-4ffb7f58d06f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:18.931224 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a74e702a-65b9-4486-8a8c-4ffb7f58d06f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:18.959669 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-a74e702a-65b9-4486-8a8c-4ffb7f58d06f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043075 May 12 11:49:18.960221 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 292/576] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 12 11:49:18 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:19.016562 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-fe6b5dd5-41bc-485b-a05e-59cdabf1197a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:19.017077 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-fe6b5dd5-41bc-485b-a05e-59cdabf1197a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:19.022870 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fe6b5dd5-41bc-485b-a05e-59cdabf1197a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:19.023307 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fe6b5dd5-41bc-485b-a05e-59cdabf1197a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:19.024087 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fe6b5dd5-41bc-485b-a05e-59cdabf1197a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:19.024513 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fe6b5dd5-41bc-485b-a05e-59cdabf1197a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:19.048654 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-fe6b5dd5-41bc-485b-a05e-59cdabf1197a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Going to try to terminate instance {{(pid=123507) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 11:49:19.120629 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-fe6b5dd5-41bc-485b-a05e-59cdabf1197a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 204 len: 0 microversion: 2.20 time: 0.107652 May 12 11:49:19.121292 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 285/577] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 12 11:49:19 2022] DELETE /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 11:49:19.129677 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-eae08cb5-741f-4533-b7ba-07f62c99be31 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:19.130335 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-eae08cb5-741f-4533-b7ba-07f62c99be31 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:19.136210 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-eae08cb5-741f-4533-b7ba-07f62c99be31 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:19.136667 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-eae08cb5-741f-4533-b7ba-07f62c99be31 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:19.137885 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-eae08cb5-741f-4533-b7ba-07f62c99be31 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:19.138334 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-eae08cb5-741f-4533-b7ba-07f62c99be31 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:19.263918 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-eae08cb5-741f-4533-b7ba-07f62c99be31 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:19.271945 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-eae08cb5-741f-4533-b7ba-07f62c99be31 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:19.273069 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-19faa286-c7b3-448f-a664-3d53fd2bfc91 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:19.273497 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-eae08cb5-741f-4533-b7ba-07f62c99be31 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:19.273826 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-19faa286-c7b3-448f-a664-3d53fd2bfc91 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: ba6039b3-958e-46ef-83e3-a942c113b22a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:19.274691 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-eae08cb5-741f-4533-b7ba-07f62c99be31 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.149088 May 12 11:49:19.275414 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 293/578] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:49:19 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:49:19.280537 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-19faa286-c7b3-448f-a664-3d53fd2bfc91 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:19.281581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-19faa286-c7b3-448f-a664-3d53fd2bfc91 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:19.282711 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-19faa286-c7b3-448f-a664-3d53fd2bfc91 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:19.283601 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-19faa286-c7b3-448f-a664-3d53fd2bfc91 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:19.286522 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-37f7103b-c770-4a6a-8649-1074af5f7c6e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:19.287130 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-37f7103b-c770-4a6a-8649-1074af5f7c6e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:19.293341 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-37f7103b-c770-4a6a-8649-1074af5f7c6e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:19.294617 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-37f7103b-c770-4a6a-8649-1074af5f7c6e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:19.295393 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-37f7103b-c770-4a6a-8649-1074af5f7c6e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:19.295829 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-37f7103b-c770-4a6a-8649-1074af5f7c6e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:19.351699 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-19faa286-c7b3-448f-a664-3d53fd2bfc91 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:19.359165 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-19faa286-c7b3-448f-a664-3d53fd2bfc91 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a" status: 200 len: 1270 microversion: 2.1 time: 0.090604 May 12 11:49:19.359919 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 286/579] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:19 2022] GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:49:19.424843 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-37f7103b-c770-4a6a-8649-1074af5f7c6e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:19.431981 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-37f7103b-c770-4a6a-8649-1074af5f7c6e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1676 microversion: 2.1 time: 0.149538 May 12 11:49:19.432541 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 294/580] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:19 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:49:20.293246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-59749d5e-3b83-40ca-a280-578c102de8c5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:20.293892 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-59749d5e-3b83-40ca-a280-578c102de8c5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:20.300215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-59749d5e-3b83-40ca-a280-578c102de8c5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:20.300665 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-59749d5e-3b83-40ca-a280-578c102de8c5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:20.301428 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-59749d5e-3b83-40ca-a280-578c102de8c5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:20.301897 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-59749d5e-3b83-40ca-a280-578c102de8c5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:20.376386 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-804f2e07-c86c-4707-b132-ed04a3417be4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:20.377176 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-804f2e07-c86c-4707-b132-ed04a3417be4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: ba6039b3-958e-46ef-83e3-a942c113b22a] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:20.383062 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-804f2e07-c86c-4707-b132-ed04a3417be4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:20.383511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-804f2e07-c86c-4707-b132-ed04a3417be4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:20.384275 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-804f2e07-c86c-4707-b132-ed04a3417be4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:20.384711 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-804f2e07-c86c-4707-b132-ed04a3417be4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:20.425689 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-59749d5e-3b83-40ca-a280-578c102de8c5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:20.433553 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-59749d5e-3b83-40ca-a280-578c102de8c5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:20.435674 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-59749d5e-3b83-40ca-a280-578c102de8c5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:20.436940 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-59749d5e-3b83-40ca-a280-578c102de8c5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.147548 May 12 11:49:20.437573 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 287/581] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:49:20 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:49:20.446377 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-804f2e07-c86c-4707-b132-ed04a3417be4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:20.452639 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-190d7c69-a21d-4ce8-aa7a-ddd76cc84259 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:20.453292 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-190d7c69-a21d-4ce8-aa7a-ddd76cc84259 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:20.455159 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-804f2e07-c86c-4707-b132-ed04a3417be4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a" status: 200 len: 1278 microversion: 2.1 time: 0.082893 May 12 11:49:20.455933 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 295/582] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:20 2022] GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a => generated 1278 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:49:20.459375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-190d7c69-a21d-4ce8-aa7a-ddd76cc84259 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:20.459830 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-190d7c69-a21d-4ce8-aa7a-ddd76cc84259 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:20.460615 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-190d7c69-a21d-4ce8-aa7a-ddd76cc84259 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:20.461054 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-190d7c69-a21d-4ce8-aa7a-ddd76cc84259 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:20.587058 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-190d7c69-a21d-4ce8-aa7a-ddd76cc84259 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:20.594562 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-190d7c69-a21d-4ce8-aa7a-ddd76cc84259 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1676 microversion: 2.1 time: 0.150195 May 12 11:49:20.595428 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 288/583] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:20 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:49:21.456079 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-c3856420-3bb0-467e-af73-cc9a28d6778c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:21.456856 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-c3856420-3bb0-467e-af73-cc9a28d6778c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:21.463677 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c3856420-3bb0-467e-af73-cc9a28d6778c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:21.464215 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c3856420-3bb0-467e-af73-cc9a28d6778c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:21.465075 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c3856420-3bb0-467e-af73-cc9a28d6778c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:21.467321 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c3856420-3bb0-467e-af73-cc9a28d6778c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:21.477864 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-9688eb30-3fd2-4e28-a5b0-a80528ded009 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:21.482136 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-9688eb30-3fd2-4e28-a5b0-a80528ded009 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: ba6039b3-958e-46ef-83e3-a942c113b22a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:21.499157 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9688eb30-3fd2-4e28-a5b0-a80528ded009 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:21.499885 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9688eb30-3fd2-4e28-a5b0-a80528ded009 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:21.500688 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9688eb30-3fd2-4e28-a5b0-a80528ded009 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:21.501123 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9688eb30-3fd2-4e28-a5b0-a80528ded009 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:21.585735 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-9688eb30-3fd2-4e28-a5b0-a80528ded009 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:21.599387 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-9688eb30-3fd2-4e28-a5b0-a80528ded009 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a" status: 200 len: 1276 microversion: 2.1 time: 0.124531 May 12 11:49:21.602617 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 289/584] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:21 2022] GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a => generated 1276 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:21.613073 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-202d2891-b19c-4d26-a391-3e7c9cc46fdb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:21.613689 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-202d2891-b19c-4d26-a391-3e7c9cc46fdb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:21.619929 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-202d2891-b19c-4d26-a391-3e7c9cc46fdb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:21.620380 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-202d2891-b19c-4d26-a391-3e7c9cc46fdb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:21.621166 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-202d2891-b19c-4d26-a391-3e7c9cc46fdb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:21.621608 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-202d2891-b19c-4d26-a391-3e7c9cc46fdb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:21.701242 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c3856420-3bb0-467e-af73-cc9a28d6778c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:21.709844 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c3856420-3bb0-467e-af73-cc9a28d6778c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:21.711387 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c3856420-3bb0-467e-af73-cc9a28d6778c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:21.712551 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-c3856420-3bb0-467e-af73-cc9a28d6778c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1722 microversion: 2.20 time: 0.261376 May 12 11:49:21.719163 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 296/585] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:49:21 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:49:21.836150 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-202d2891-b19c-4d26-a391-3e7c9cc46fdb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:21.844495 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-202d2891-b19c-4d26-a391-3e7c9cc46fdb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1676 microversion: 2.1 time: 0.235895 May 12 11:49:21.854222 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 290/586] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:21 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1676 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:22.586474 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-b2f47fd2-6609-4fd2-aa0b-cc8ce14ead87 req-953a02aa-abda-4b51-94b3-4ef6b1f16fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5cd2aad-2374-4ded-8b72-2e54fbbad916", "name": "network-vif-deleted", "tag": "d3632d97-f0ea-41b4-9003-a50ffebf91df"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:49:22.610171 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-b2f47fd2-6609-4fd2-aa0b-cc8ce14ead87 req-953a02aa-abda-4b51-94b3-4ef6b1f16fa9 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:22.613083 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-b2f47fd2-6609-4fd2-aa0b-cc8ce14ead87 req-953a02aa-abda-4b51-94b3-4ef6b1f16fa9 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:22.617901 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-ce07f48c-66f0-4a83-bc69-780b9d3877fe tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:22.618607 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-ce07f48c-66f0-4a83-bc69-780b9d3877fe tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: ba6039b3-958e-46ef-83e3-a942c113b22a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:22.630344 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-b2f47fd2-6609-4fd2-aa0b-cc8ce14ead87 req-953a02aa-abda-4b51-94b3-4ef6b1f16fa9 service nova] Creating event network-vif-deleted:d3632d97-f0ea-41b4-9003-a50ffebf91df for instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 on hv-cinder-80473 May 12 11:49:22.632874 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ce07f48c-66f0-4a83-bc69-780b9d3877fe tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:22.633331 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ce07f48c-66f0-4a83-bc69-780b9d3877fe tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:22.634273 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ce07f48c-66f0-4a83-bc69-780b9d3877fe tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:22.635845 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ce07f48c-66f0-4a83-bc69-780b9d3877fe tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:22.638596 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-b2f47fd2-6609-4fd2-aa0b-cc8ce14ead87 req-953a02aa-abda-4b51-94b3-4ef6b1f16fa9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056334 May 12 11:49:22.645367 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 297/587] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:49:22.664917 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-51b3a842-dc9d-4179-b687-373017d9c8d5 req-895b3cda-d2be-410b-8aca-e5137c7ff6b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba6039b3-958e-46ef-83e3-a942c113b22a", "tag": "5a435639-c474-4088-a6dd-c7e042256655"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:49:22.685762 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-51b3a842-dc9d-4179-b687-373017d9c8d5 req-895b3cda-d2be-410b-8aca-e5137c7ff6b3 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:22.687062 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-51b3a842-dc9d-4179-b687-373017d9c8d5 req-895b3cda-d2be-410b-8aca-e5137c7ff6b3 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:22.700778 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-51b3a842-dc9d-4179-b687-373017d9c8d5 req-895b3cda-d2be-410b-8aca-e5137c7ff6b3 service nova] Creating event network-changed:5a435639-c474-4088-a6dd-c7e042256655 for instance ba6039b3-958e-46ef-83e3-a942c113b22a on hv-cinder-80473 May 12 11:49:22.707570 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-51b3a842-dc9d-4179-b687-373017d9c8d5 req-895b3cda-d2be-410b-8aca-e5137c7ff6b3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050992 May 12 11:49:22.708743 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 298/588] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:49:22.732208 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-34c49560-a5a9-4f2b-a81e-cca14d80a1d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:22.732909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-34c49560-a5a9-4f2b-a81e-cca14d80a1d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:22.739199 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-34c49560-a5a9-4f2b-a81e-cca14d80a1d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:22.739654 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-34c49560-a5a9-4f2b-a81e-cca14d80a1d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:22.740439 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-34c49560-a5a9-4f2b-a81e-cca14d80a1d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:22.741054 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-34c49560-a5a9-4f2b-a81e-cca14d80a1d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:22.786635 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-34c49560-a5a9-4f2b-a81e-cca14d80a1d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:22.792949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-34c49560-a5a9-4f2b-a81e-cca14d80a1d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:22.793684 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.objects.instance [None req-34c49560-a5a9-4f2b-a81e-cca14d80a1d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lazy-loading 'fault' on Instance uuid c5cd2aad-2374-4ded-8b72-2e54fbbad916 {{(pid=123508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:49:22.854702 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-ce07f48c-66f0-4a83-bc69-780b9d3877fe tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:22.857479 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-34c49560-a5a9-4f2b-a81e-cca14d80a1d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:22.865766 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-ce07f48c-66f0-4a83-bc69-780b9d3877fe tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a" status: 200 len: 1318 microversion: 2.1 time: 0.252170 May 12 11:49:22.866623 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 291/589] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:22 2022] GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:22.869440 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-34c49560-a5a9-4f2b-a81e-cca14d80a1d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:22.871618 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-f9faf5ba-18f5-40b3-ab6a-3500a480f380 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:22.872460 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-f9faf5ba-18f5-40b3-ab6a-3500a480f380 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:22.872837 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-34c49560-a5a9-4f2b-a81e-cca14d80a1d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:22.878237 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-34c49560-a5a9-4f2b-a81e-cca14d80a1d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 200 len: 1372 microversion: 2.20 time: 0.146970 May 12 11:49:22.879151 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f9faf5ba-18f5-40b3-ab6a-3500a480f380 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:22.880041 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f9faf5ba-18f5-40b3-ab6a-3500a480f380 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:22.881028 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f9faf5ba-18f5-40b3-ab6a-3500a480f380 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:22.881672 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f9faf5ba-18f5-40b3-ab6a-3500a480f380 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:22.889621 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 299/590] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:49:22 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:49:23.018684 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-f9faf5ba-18f5-40b3-ab6a-3500a480f380 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:23.026246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-f9faf5ba-18f5-40b3-ab6a-3500a480f380 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1676 microversion: 2.1 time: 0.158365 May 12 11:49:23.026820 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 292/591] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:22 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:23.882821 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-c26d544c-f69e-4a42-bcbe-825e84d4f0d3 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:23.883686 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-c26d544c-f69e-4a42-bcbe-825e84d4f0d3 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: ba6039b3-958e-46ef-83e3-a942c113b22a] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:23.890730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c26d544c-f69e-4a42-bcbe-825e84d4f0d3 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:23.891559 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c26d544c-f69e-4a42-bcbe-825e84d4f0d3 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:23.892408 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c26d544c-f69e-4a42-bcbe-825e84d4f0d3 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:23.892920 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c26d544c-f69e-4a42-bcbe-825e84d4f0d3 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:23.896578 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-01fa1c2f-5169-41e2-b4e9-c52b1e11a4f9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:23.897188 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-01fa1c2f-5169-41e2-b4e9-c52b1e11a4f9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:23.903899 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-01fa1c2f-5169-41e2-b4e9-c52b1e11a4f9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:23.904546 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-01fa1c2f-5169-41e2-b4e9-c52b1e11a4f9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:23.905328 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-01fa1c2f-5169-41e2-b4e9-c52b1e11a4f9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:23.905943 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-01fa1c2f-5169-41e2-b4e9-c52b1e11a4f9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:23.919505 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-01fa1c2f-5169-41e2-b4e9-c52b1e11a4f9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] HTTP exception thrown: Instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 could not be found. May 12 11:49:23.921246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-01fa1c2f-5169-41e2-b4e9-c52b1e11a4f9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Request method failure captured: May 12 11:49:23.921246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 HTTP/1.1 May 12 11:49:23.921246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:49:23.921246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:49:23.921246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:49:23.921246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 0 May 12 11:49:23.921246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:49:23.921246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:49:23.921246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:49:23.921246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:49:23.921246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPNAJBskQ01M3Bd-pOdrqHnMkzj_IA3v-gV_GKs3p_RPwGyRb5_ums4Nt3oztaW2WD7kvjB_YHdu35UolYaZX08nADmNaUOGWRxSAflC1nPoI10kF90cbescoL5ieRAIeNUHGbBmJN57yMlM6qJdGVdAnzym-VeousEAjmnedXsQZCs May 12 11:49:23.921246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:49:23.921246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:49:23.921246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:49:23.921246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:49:23.921246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Openstack-Nova-Api-Version: 2.20 May 12 11:49:23.921246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:49:23.921246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:49:23.921246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: 079cb1c02174440091d4c5bcbc27bdc5 May 12 11:49:23.921246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1052935867 May 12 11:49:23.921246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:49:23.921246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:49:23.922680 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/079cb1c02174440091d4c5bcbc27bdc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/079cb1c02174440091d4c5bcbc27bdc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/079cb1c02174440091d4c5bcbc27bdc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_079cb1c02174440091d4c5bcbc27bdc5", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:49:23.922680 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1052935867 May 12 11:49:23.922680 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: 079cb1c02174440091d4c5bcbc27bdc5 May 12 11:49:23.922680 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1052935867 May 12 11:49:23.922680 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-AttachVolumeShelveTestJSON-1052935867-project May 12 11:49:23.922680 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:49:23.922680 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:49:23.922680 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: 635d1cf64110483b843b01e6e6ddc749 May 12 11:49:23.922680 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1052935867-project May 12 11:49:23.922680 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: > May 12 11:49:23.922680 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 could not be found. May 12 11:49:23.922680 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'id': 'c5cd2aad-2374-4ded-8b72-2e54fbbad916'} May 12 11:49:23.923449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:49:23.923449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:49:23.923449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:49:23.923449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:49:23.923449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:49:23.923449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:49:23.923449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:49:23.923449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:49:23.923449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:49:23.923449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:49:23.923449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 could not be found. May 12 11:49:23.923449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:49:23.923449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:49:23.923449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:49:23.923449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:49:23.923449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:49:23.923449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:49:23.923449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:49:23.923449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:49:23.923449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:49:23.924778 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:49:23.924778 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:49:23.924778 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:49:23.924778 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:49:23.924778 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:49:23.924778 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:49:23.924778 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:49:23.924778 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 could not be found. May 12 11:49:23.924778 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:49:23.924778 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:49:23.924778 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:49:23.924778 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:49:23.924778 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:49:23.924778 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:49:23.924778 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:49:23.924778 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:49:23.924778 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 could not be found. May 12 11:49:23.924778 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:49:23.925812 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-01fa1c2f-5169-41e2-b4e9-c52b1e11a4f9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Returning 404 to user: Instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 could not be found. {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:49:23.925812 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-01fa1c2f-5169-41e2-b4e9-c52b1e11a4f9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 404 len: 111 microversion: 2.20 time: 0.030235 May 12 11:49:23.926624 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 293/592] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:49:23 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 12 11:49:23.931132 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-36502832-84bf-493d-bebf-7fd8a0786551 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '.version_select at 0x7f29f1caf310>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:23.951360 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-36502832-84bf-493d-bebf-7fd8a0786551 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120942243" status: 204 len: 0 microversion: 2.20 time: 0.023699 May 12 11:49:23.952162 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 294/593] 10.222.0.58 () {60 vars in 1261 bytes} [Thu May 12 11:49:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120942243 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 11:49:24.030161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c26d544c-f69e-4a42-bcbe-825e84d4f0d3 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:24.039053 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-c26d544c-f69e-4a42-bcbe-825e84d4f0d3 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a" status: 200 len: 1318 microversion: 2.1 time: 0.158659 May 12 11:49:24.040218 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 300/594] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:23 2022] GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:24.051658 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-581d6ada-70b6-42e2-8c6b-973dac5eb393 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:24.052539 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-581d6ada-70b6-42e2-8c6b-973dac5eb393 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:24.059209 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-581d6ada-70b6-42e2-8c6b-973dac5eb393 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:24.059903 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-581d6ada-70b6-42e2-8c6b-973dac5eb393 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:24.060843 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-581d6ada-70b6-42e2-8c6b-973dac5eb393 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:24.061286 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-581d6ada-70b6-42e2-8c6b-973dac5eb393 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:24.225330 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-581d6ada-70b6-42e2-8c6b-973dac5eb393 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:24.232836 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-581d6ada-70b6-42e2-8c6b-973dac5eb393 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1676 microversion: 2.1 time: 0.184956 May 12 11:49:24.233911 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 295/595] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:24 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1676 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:24.625198 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ff078007-10a3-41a1-8ad7-e4e28f46693f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Action: 'create', calling method: .version_select at 0x7f29f24dcaf0>, body: {"keypair": {"name": "tempest-keypair-1320910538", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb9FBWDeSITXC/+WCDmVsbvQVgwDwIx8OIimZUEIBDxq0ozvWCeZRkmNbHtlmofk7ALrsF3JIWbDevHQlMjY0BDPwr/zRv/QFjHAshusMvwjDLs3D9Veb0zaIjejkjLug=="}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:49:24.640313 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-ff078007-10a3-41a1-8ad7-e4e28f46693f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Getting quotas for project 079cb1c02174440091d4c5bcbc27bdc5. Resources: {'key_pairs'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:49:24.644095 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-ff078007-10a3-41a1-8ad7-e4e28f46693f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Getting quotas for user 635d1cf64110483b843b01e6e6ddc749 and project 079cb1c02174440091d4c5bcbc27bdc5. Resources: {'key_pairs'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:49:24.665369 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-ff078007-10a3-41a1-8ad7-e4e28f46693f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044629 May 12 11:49:24.666005 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 301/596] 10.222.0.58 () {62 vars in 1199 bytes} [Thu May 12 11:49:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 12 11:49:25.054200 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-6d86e002-9248-4302-bca1-1cabc85b1d40 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:25.058126 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-6d86e002-9248-4302-bca1-1cabc85b1d40 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: ba6039b3-958e-46ef-83e3-a942c113b22a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:25.065271 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6d86e002-9248-4302-bca1-1cabc85b1d40 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:25.065794 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6d86e002-9248-4302-bca1-1cabc85b1d40 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:25.066798 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6d86e002-9248-4302-bca1-1cabc85b1d40 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:25.067285 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6d86e002-9248-4302-bca1-1cabc85b1d40 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:25.217947 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-6d86e002-9248-4302-bca1-1cabc85b1d40 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:25.226050 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-6d86e002-9248-4302-bca1-1cabc85b1d40 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a" status: 200 len: 1318 microversion: 2.1 time: 0.175595 May 12 11:49:25.226648 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 296/597] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:25 2022] GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:25.250409 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-cf6bd3f9-35e1-4f18-aaab-f654caa6c58d tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:25.251200 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-cf6bd3f9-35e1-4f18-aaab-f654caa6c58d tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:25.258339 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cf6bd3f9-35e1-4f18-aaab-f654caa6c58d tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:25.258789 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cf6bd3f9-35e1-4f18-aaab-f654caa6c58d tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:25.260186 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cf6bd3f9-35e1-4f18-aaab-f654caa6c58d tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:25.260632 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cf6bd3f9-35e1-4f18-aaab-f654caa6c58d tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:25.477939 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-cf6bd3f9-35e1-4f18-aaab-f654caa6c58d tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:25.485161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-cf6bd3f9-35e1-4f18-aaab-f654caa6c58d tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1653 microversion: 2.1 time: 0.238748 May 12 11:49:25.492247 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 302/598] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:25 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1653 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:25.501357 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-3c1d0f8e-6203-497c-823a-fe84a7a654d8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:49:25.507456 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3c1d0f8e-6203-497c-823a-fe84a7a654d8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:25.507908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3c1d0f8e-6203-497c-823a-fe84a7a654d8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:25.531368 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-3c1d0f8e-6203-497c-823a-fe84a7a654d8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Going to try to start instance {{(pid=123507) start /opt/stack/nova/nova/compute/api.py:2730}} May 12 11:49:25.577945 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-3c1d0f8e-6203-497c-823a-fe84a7a654d8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "POST /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2/action" status: 202 len: 0 microversion: 2.1 time: 0.079932 May 12 11:49:25.579106 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 297/599] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 12 11:49:25 2022] POST /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:49:25.586798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-760ea97d-fb5b-44fb-892e-d27de463c38e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:25.587711 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-760ea97d-fb5b-44fb-892e-d27de463c38e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:25.595112 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-760ea97d-fb5b-44fb-892e-d27de463c38e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:25.596003 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-760ea97d-fb5b-44fb-892e-d27de463c38e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:25.596852 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-760ea97d-fb5b-44fb-892e-d27de463c38e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:25.597563 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-760ea97d-fb5b-44fb-892e-d27de463c38e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:25.830047 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-760ea97d-fb5b-44fb-892e-d27de463c38e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:25.837330 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-760ea97d-fb5b-44fb-892e-d27de463c38e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1662 microversion: 2.1 time: 0.254430 May 12 11:49:25.837926 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 303/600] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:25 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1662 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:26.244535 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-2be40327-9bfa-4be3-a0b1-75cc327210ac tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:26.245254 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-2be40327-9bfa-4be3-a0b1-75cc327210ac tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: ba6039b3-958e-46ef-83e3-a942c113b22a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:26.252005 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2be40327-9bfa-4be3-a0b1-75cc327210ac tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:26.252659 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2be40327-9bfa-4be3-a0b1-75cc327210ac tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:26.253597 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2be40327-9bfa-4be3-a0b1-75cc327210ac tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:26.254201 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2be40327-9bfa-4be3-a0b1-75cc327210ac tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:26.402798 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-2be40327-9bfa-4be3-a0b1-75cc327210ac tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:26.410601 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-2be40327-9bfa-4be3-a0b1-75cc327210ac tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a" status: 200 len: 1318 microversion: 2.1 time: 0.170646 May 12 11:49:26.413498 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 298/601] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:26 2022] GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:26.499002 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ea2daf75-f25e-4ed0-af76-ee48354dc224 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1237116422", "imageRef": "576e8b7b-771b-47aa-89c6-ff04accc9bea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eff33054-22ac-4705-93a5-40677c07e79b"}], "security_groups": [{"name": "tempest-securitygroup--975232042"}], "key_name": "tempest-keypair-1320910538", "user_data": "}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:49:26.603997 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.network.neutron [None req-ea2daf75-f25e-4ed0-af76-ee48354dc224 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] validate_networks() for [('eff33054-22ac-4705-93a5-40677c07e79b', None, None, None, None, None)] {{(pid=123508) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 11:49:26.854512 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-4c824648-998a-442d-99f1-510cf33b0ecc tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:26.855046 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-4c824648-998a-442d-99f1-510cf33b0ecc tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:26.861489 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4c824648-998a-442d-99f1-510cf33b0ecc tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:26.861979 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4c824648-998a-442d-99f1-510cf33b0ecc tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:26.862753 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4c824648-998a-442d-99f1-510cf33b0ecc tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:26.863188 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4c824648-998a-442d-99f1-510cf33b0ecc tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:26.966761 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-ea2daf75-f25e-4ed0-af76-ee48354dc224 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Flavor limits 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 11:49:26.967188 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-ea2daf75-f25e-4ed0-af76-ee48354dc224 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Image limits 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 11:49:26.967721 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-ea2daf75-f25e-4ed0-af76-ee48354dc224 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Flavor pref 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 11:49:26.968135 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-ea2daf75-f25e-4ed0-af76-ee48354dc224 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Image pref 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 11:49:26.968550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-ea2daf75-f25e-4ed0-af76-ee48354dc224 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 11:49:26.977354 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ea2daf75-f25e-4ed0-af76-ee48354dc224 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:26.977843 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ea2daf75-f25e-4ed0-af76-ee48354dc224 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:26.978651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ea2daf75-f25e-4ed0-af76-ee48354dc224 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:26.979122 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ea2daf75-f25e-4ed0-af76-ee48354dc224 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:26.990800 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-4c824648-998a-442d-99f1-510cf33b0ecc tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:26.997653 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-ea2daf75-f25e-4ed0-af76-ee48354dc224 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Getting quotas for project 079cb1c02174440091d4c5bcbc27bdc5. Resources: {'ram', 'cores', 'instances'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:49:26.999068 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-4c824648-998a-442d-99f1-510cf33b0ecc tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1662 microversion: 2.1 time: 0.148414 May 12 11:49:27.000153 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 299/602] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:26 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1662 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:27.006995 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-ea2daf75-f25e-4ed0-af76-ee48354dc224 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Getting quotas for user 635d1cf64110483b843b01e6e6ddc749 and project 079cb1c02174440091d4c5bcbc27bdc5. Resources: {'ram', 'cores', 'instances'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:49:27.017904 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-ea2daf75-f25e-4ed0-af76-ee48354dc224 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Going to run 1 instances... {{(pid=123508) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 11:49:27.020154 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-ea2daf75-f25e-4ed0-af76-ee48354dc224 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='576e8b7b-771b-47aa-89c6-ff04accc9bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 11:49:27.066020 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-ea2daf75-f25e-4ed0-af76-ee48354dc224 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.571367 May 12 11:49:27.066665 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 304/603] 10.222.0.58 () {62 vars in 1187 bytes} [Thu May 12 11:49:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 12 11:49:27.076466 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-18ed7a4d-9bf0-423f-a268-52a0ce1f0edf tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:27.077070 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-18ed7a4d-9bf0-423f-a268-52a0ce1f0edf tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:27.136282 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-18ed7a4d-9bf0-423f-a268-52a0ce1f0edf tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:27.144147 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-18ed7a4d-9bf0-423f-a268-52a0ce1f0edf tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:27.145802 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-18ed7a4d-9bf0-423f-a268-52a0ce1f0edf tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:27.146915 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-18ed7a4d-9bf0-423f-a268-52a0ce1f0edf tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1282 microversion: 2.20 time: 0.074286 May 12 11:49:27.147484 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 300/604] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:49:27 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1282 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:49:27.428641 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-bda2c986-4365-4094-8d3e-0d1175acba3c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:27.429594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-bda2c986-4365-4094-8d3e-0d1175acba3c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: ba6039b3-958e-46ef-83e3-a942c113b22a] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:27.438725 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bda2c986-4365-4094-8d3e-0d1175acba3c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:27.439272 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bda2c986-4365-4094-8d3e-0d1175acba3c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:27.440041 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bda2c986-4365-4094-8d3e-0d1175acba3c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:27.440475 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bda2c986-4365-4094-8d3e-0d1175acba3c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:27.566969 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-bda2c986-4365-4094-8d3e-0d1175acba3c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:27.576065 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-bda2c986-4365-4094-8d3e-0d1175acba3c tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a" status: 200 len: 1318 microversion: 2.1 time: 0.151597 May 12 11:49:27.576779 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 305/605] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:27 2022] GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:49:28.016122 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-87346b7f-0613-45b3-a9c6-194d31de5302 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:28.016734 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-87346b7f-0613-45b3-a9c6-194d31de5302 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:28.023792 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-87346b7f-0613-45b3-a9c6-194d31de5302 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:28.024245 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-87346b7f-0613-45b3-a9c6-194d31de5302 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:28.025010 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-87346b7f-0613-45b3-a9c6-194d31de5302 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:28.025443 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-87346b7f-0613-45b3-a9c6-194d31de5302 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:28.151488 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-87346b7f-0613-45b3-a9c6-194d31de5302 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:28.159708 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-87346b7f-0613-45b3-a9c6-194d31de5302 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1666 microversion: 2.1 time: 0.147318 May 12 11:49:28.166412 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 301/606] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:28 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1666 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:28.166740 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ae70f8cb-0c95-4577-9544-d3e965ec5154 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:28.167357 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-ae70f8cb-0c95-4577-9544-d3e965ec5154 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:28.174038 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ae70f8cb-0c95-4577-9544-d3e965ec5154 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:28.174484 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ae70f8cb-0c95-4577-9544-d3e965ec5154 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:28.175245 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ae70f8cb-0c95-4577-9544-d3e965ec5154 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:28.175677 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ae70f8cb-0c95-4577-9544-d3e965ec5154 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:28.248344 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-ae70f8cb-0c95-4577-9544-d3e965ec5154 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:28.259418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-ae70f8cb-0c95-4577-9544-d3e965ec5154 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:28.260963 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-ae70f8cb-0c95-4577-9544-d3e965ec5154 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:28.262110 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-ae70f8cb-0c95-4577-9544-d3e965ec5154 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1342 microversion: 2.20 time: 0.100976 May 12 11:49:28.262935 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 306/607] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:49:28 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1342 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:49:28.594667 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-5946e392-48bc-46c5-ab65-afc896a269ff tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:28.595288 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-5946e392-48bc-46c5-ab65-afc896a269ff tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: ba6039b3-958e-46ef-83e3-a942c113b22a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:28.601624 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5946e392-48bc-46c5-ab65-afc896a269ff tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:28.602115 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5946e392-48bc-46c5-ab65-afc896a269ff tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:28.602888 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5946e392-48bc-46c5-ab65-afc896a269ff tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:28.603317 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5946e392-48bc-46c5-ab65-afc896a269ff tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:28.731375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-5946e392-48bc-46c5-ab65-afc896a269ff tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:28.738835 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-5946e392-48bc-46c5-ab65-afc896a269ff tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a" status: 200 len: 1318 microversion: 2.1 time: 0.148639 May 12 11:49:28.739405 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 302/608] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:28 2022] GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:29.281259 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-0c87c80f-9af1-4baa-859a-be6d804135e3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:29.281845 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-0c87c80f-9af1-4baa-859a-be6d804135e3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:29.288495 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0c87c80f-9af1-4baa-859a-be6d804135e3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:29.288956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0c87c80f-9af1-4baa-859a-be6d804135e3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:29.289775 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0c87c80f-9af1-4baa-859a-be6d804135e3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:29.290227 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0c87c80f-9af1-4baa-859a-be6d804135e3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:29.637218 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-0c87c80f-9af1-4baa-859a-be6d804135e3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:29.645508 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-0c87c80f-9af1-4baa-859a-be6d804135e3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:29.647045 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-0c87c80f-9af1-4baa-859a-be6d804135e3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:29.648154 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-0c87c80f-9af1-4baa-859a-be6d804135e3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1407 microversion: 2.20 time: 0.371593 May 12 11:49:29.648724 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 307/609] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:49:29 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1407 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:49:29.755927 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-3a382a79-ea26-4e46-ac44-ec5eb27baf5a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:29.756683 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-3a382a79-ea26-4e46-ac44-ec5eb27baf5a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: ba6039b3-958e-46ef-83e3-a942c113b22a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:29.763848 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3a382a79-ea26-4e46-ac44-ec5eb27baf5a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:29.764435 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3a382a79-ea26-4e46-ac44-ec5eb27baf5a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:29.765319 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3a382a79-ea26-4e46-ac44-ec5eb27baf5a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:29.765913 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3a382a79-ea26-4e46-ac44-ec5eb27baf5a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:29.972077 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-3a382a79-ea26-4e46-ac44-ec5eb27baf5a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:29.979821 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-3a382a79-ea26-4e46-ac44-ec5eb27baf5a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a" status: 200 len: 1318 microversion: 2.1 time: 0.227755 May 12 11:49:29.980399 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 303/610] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:29 2022] GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:49:30.061294 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-dab07870-678c-489e-842d-a3fcd83bbf05 req-9947e17f-e382-410c-ae48-03df7e43d898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba6039b3-958e-46ef-83e3-a942c113b22a", "name": "network-vif-plugged", "status": "completed", "tag": "5a435639-c474-4088-a6dd-c7e042256655"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:49:30.069443 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-dab07870-678c-489e-842d-a3fcd83bbf05 req-9947e17f-e382-410c-ae48-03df7e43d898 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:30.069935 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-dab07870-678c-489e-842d-a3fcd83bbf05 req-9947e17f-e382-410c-ae48-03df7e43d898 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:30.082016 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-dab07870-678c-489e-842d-a3fcd83bbf05 req-9947e17f-e382-410c-ae48-03df7e43d898 service nova] Creating event network-vif-plugged:5a435639-c474-4088-a6dd-c7e042256655 for instance ba6039b3-958e-46ef-83e3-a942c113b22a on hv-cinder-80473 May 12 11:49:30.086879 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-dab07870-678c-489e-842d-a3fcd83bbf05 req-9947e17f-e382-410c-ae48-03df7e43d898 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029225 May 12 11:49:30.087483 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 308/611] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:49:30.115570 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-13256ac2-dbf8-49fd-b625-3247628f165a req-bba7c546-57ec-424c-84e4-472a475fa198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efbc8e04-31bd-4238-8c9a-096ad87a46ab", "tag": "e62c63ee-3f94-4556-b00c-c45c7465fd0e"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:49:30.128053 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-13256ac2-dbf8-49fd-b625-3247628f165a req-bba7c546-57ec-424c-84e4-472a475fa198 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:30.128886 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-13256ac2-dbf8-49fd-b625-3247628f165a req-bba7c546-57ec-424c-84e4-472a475fa198 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:30.131382 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-296e8b4f-e50f-4291-ad91-d0b779747af1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2140154362"}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:49:30.132012 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-296e8b4f-e50f-4291-ad91-d0b779747af1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:30.143240 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-13256ac2-dbf8-49fd-b625-3247628f165a req-bba7c546-57ec-424c-84e4-472a475fa198 service nova] Creating event network-changed:e62c63ee-3f94-4556-b00c-c45c7465fd0e for instance efbc8e04-31bd-4238-8c9a-096ad87a46ab on hv-cinder-80473 May 12 11:49:30.156011 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-13256ac2-dbf8-49fd-b625-3247628f165a req-bba7c546-57ec-424c-84e4-472a475fa198 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044876 May 12 11:49:30.161024 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 304/612] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:49:30.161227 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-296e8b4f-e50f-4291-ad91-d0b779747af1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:30.161990 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-296e8b4f-e50f-4291-ad91-d0b779747af1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:30.163433 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-296e8b4f-e50f-4291-ad91-d0b779747af1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:30.163887 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-296e8b4f-e50f-4291-ad91-d0b779747af1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:30.374262 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.network.security_group_api [None req-296e8b4f-e50f-4291-ad91-d0b779747af1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Removing security group 06bb2f2f-3b67-447e-b9d3-94a9680fb745 from port 5467d5f0-8b8e-4bbd-967c-8638230e171e May 12 11:49:30.667130 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-86d040db-c25b-4128-8355-3dd8e75682c2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:30.667809 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-86d040db-c25b-4128-8355-3dd8e75682c2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:30.674500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-86d040db-c25b-4128-8355-3dd8e75682c2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:30.674945 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-86d040db-c25b-4128-8355-3dd8e75682c2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:30.675734 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-86d040db-c25b-4128-8355-3dd8e75682c2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:30.676150 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-86d040db-c25b-4128-8355-3dd8e75682c2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:30.808439 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-86d040db-c25b-4128-8355-3dd8e75682c2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:30.816927 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-86d040db-c25b-4128-8355-3dd8e75682c2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:30.818451 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-86d040db-c25b-4128-8355-3dd8e75682c2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:30.819597 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-86d040db-c25b-4128-8355-3dd8e75682c2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1407 microversion: 2.20 time: 0.156791 May 12 11:49:30.820090 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 305/613] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:49:30 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:49:30.880560 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-296e8b4f-e50f-4291-ad91-d0b779747af1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "POST /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909/action" status: 202 len: 0 microversion: 2.1 time: 0.753381 May 12 11:49:30.881176 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 309/614] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 12 11:49:30 2022] POST /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909/action => generated 0 bytes in 755 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 11:49:30.996386 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-844b9213-3f0e-4c34-948d-39659128e284 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:30.997064 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-844b9213-3f0e-4c34-948d-39659128e284 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: ba6039b3-958e-46ef-83e3-a942c113b22a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:31.003692 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-844b9213-3f0e-4c34-948d-39659128e284 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:31.004249 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-844b9213-3f0e-4c34-948d-39659128e284 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:31.004828 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-844b9213-3f0e-4c34-948d-39659128e284 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:31.005253 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-844b9213-3f0e-4c34-948d-39659128e284 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:31.193174 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-844b9213-3f0e-4c34-948d-39659128e284 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:31.204038 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-844b9213-3f0e-4c34-948d-39659128e284 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a" status: 200 len: 1318 microversion: 2.1 time: 0.211327 May 12 11:49:31.205224 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 306/615] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:30 2022] GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:31.837839 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-bc9ec355-c82a-4f41-b00b-75cf3702412c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:31.838453 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-bc9ec355-c82a-4f41-b00b-75cf3702412c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:31.844365 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bc9ec355-c82a-4f41-b00b-75cf3702412c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:31.844814 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bc9ec355-c82a-4f41-b00b-75cf3702412c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:31.845582 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bc9ec355-c82a-4f41-b00b-75cf3702412c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:31.846050 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-bc9ec355-c82a-4f41-b00b-75cf3702412c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:32.050751 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-bc9ec355-c82a-4f41-b00b-75cf3702412c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:32.058532 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-bc9ec355-c82a-4f41-b00b-75cf3702412c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:32.060651 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-bc9ec355-c82a-4f41-b00b-75cf3702412c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:32.061759 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-bc9ec355-c82a-4f41-b00b-75cf3702412c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1407 microversion: 2.20 time: 0.228315 May 12 11:49:32.062311 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 310/616] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:49:31 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:49:32.169902 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-b3a64244-45ef-4349-a7eb-e102d620a7fb tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:32.170445 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-b3a64244-45ef-4349-a7eb-e102d620a7fb tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:32.182611 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-a8792d2d-f416-4c0a-959f-b06c673d6883 req-c2ec5c0d-200b-463d-9624-661aa88a9fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a03ef4f-9cf8-4749-8eb8-9077d5987909", "tag": "5467d5f0-8b8e-4bbd-967c-8638230e171e"}, {"name": "network-changed", "server_uuid": "3a03ef4f-9cf8-4749-8eb8-9077d5987909", "tag": "5467d5f0-8b8e-4bbd-967c-8638230e171e"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:49:32.182903 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b3a64244-45ef-4349-a7eb-e102d620a7fb tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:32.183591 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b3a64244-45ef-4349-a7eb-e102d620a7fb tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:32.185265 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b3a64244-45ef-4349-a7eb-e102d620a7fb tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:32.188608 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b3a64244-45ef-4349-a7eb-e102d620a7fb tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:32.194111 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-a8792d2d-f416-4c0a-959f-b06c673d6883 req-c2ec5c0d-200b-463d-9624-661aa88a9fa1 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:32.194811 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-a8792d2d-f416-4c0a-959f-b06c673d6883 req-c2ec5c0d-200b-463d-9624-661aa88a9fa1 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:32.207577 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-a8792d2d-f416-4c0a-959f-b06c673d6883 req-c2ec5c0d-200b-463d-9624-661aa88a9fa1 service nova] Creating event network-changed:5467d5f0-8b8e-4bbd-967c-8638230e171e for instance 3a03ef4f-9cf8-4749-8eb8-9077d5987909 on hv-cinder-80473 May 12 11:49:32.208444 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-a8792d2d-f416-4c0a-959f-b06c673d6883 req-c2ec5c0d-200b-463d-9624-661aa88a9fa1 service nova] Creating event network-changed:5467d5f0-8b8e-4bbd-967c-8638230e171e for instance 3a03ef4f-9cf8-4749-8eb8-9077d5987909 on hv-cinder-80473 May 12 11:49:32.215563 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-a8792d2d-f416-4c0a-959f-b06c673d6883 req-c2ec5c0d-200b-463d-9624-661aa88a9fa1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036178 May 12 11:49:32.217106 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 311/617] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:49:32.222655 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-0537ccb2-7b52-4fe6-af73-4fa8187bcc00 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:32.223641 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-0537ccb2-7b52-4fe6-af73-4fa8187bcc00 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: ba6039b3-958e-46ef-83e3-a942c113b22a] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:32.231862 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0537ccb2-7b52-4fe6-af73-4fa8187bcc00 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:32.232593 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0537ccb2-7b52-4fe6-af73-4fa8187bcc00 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:32.233600 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0537ccb2-7b52-4fe6-af73-4fa8187bcc00 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:32.234512 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0537ccb2-7b52-4fe6-af73-4fa8187bcc00 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:32.315674 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.objects.instance [None req-b3a64244-45ef-4349-a7eb-e102d620a7fb tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lazy-loading 'services' on Instance uuid 3a03ef4f-9cf8-4749-8eb8-9077d5987909 {{(pid=123507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:49:32.445924 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-b3a64244-45ef-4349-a7eb-e102d620a7fb tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909/os-volume_attachments/ea034f2b-de66-41f3-ba33-d015d67222d0" status: 202 len: 0 microversion: 2.1 time: 0.280178 May 12 11:49:32.446459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 307/618] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 12 11:49:32 2022] DELETE /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909/os-volume_attachments/ea034f2b-de66-41f3-ba33-d015d67222d0 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:49:32.463761 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-99c383f9-10ee-4d2a-9981-cebe74fa9060 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:32.476741 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-99c383f9-10ee-4d2a-9981-cebe74fa9060 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:32.484307 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-99c383f9-10ee-4d2a-9981-cebe74fa9060 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:32.485045 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-99c383f9-10ee-4d2a-9981-cebe74fa9060 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:32.486233 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-99c383f9-10ee-4d2a-9981-cebe74fa9060 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:32.492149 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-99c383f9-10ee-4d2a-9981-cebe74fa9060 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:32.538423 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-0537ccb2-7b52-4fe6-af73-4fa8187bcc00 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:32.542522 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-99c383f9-10ee-4d2a-9981-cebe74fa9060 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091164 May 12 11:49:32.543169 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 308/619] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 12 11:49:32 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:49:32.547609 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-0537ccb2-7b52-4fe6-af73-4fa8187bcc00 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a" status: 200 len: 1507 microversion: 2.1 time: 0.329039 May 12 11:49:32.548443 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 312/620] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:32 2022] GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a => generated 1507 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:32.567878 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-2210018c-2b5a-45f8-b59d-519deb19e48f tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d7b44df-8edb-4506-8ae9-b05fb0a0670f", "device": "/dev/sdb"}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:49:32.569730 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-2210018c-2b5a-45f8-b59d-519deb19e48f tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: ba6039b3-958e-46ef-83e3-a942c113b22a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:32.577904 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2210018c-2b5a-45f8-b59d-519deb19e48f tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:32.579318 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2210018c-2b5a-45f8-b59d-519deb19e48f tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:32.580409 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2210018c-2b5a-45f8-b59d-519deb19e48f tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:32.581944 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2210018c-2b5a-45f8-b59d-519deb19e48f tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:33.079660 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-0bafbdff-91ca-4198-9bd0-cf63e94dc7b7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:33.080270 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-0bafbdff-91ca-4198-9bd0-cf63e94dc7b7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:33.086725 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0bafbdff-91ca-4198-9bd0-cf63e94dc7b7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:33.087177 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0bafbdff-91ca-4198-9bd0-cf63e94dc7b7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:33.087957 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0bafbdff-91ca-4198-9bd0-cf63e94dc7b7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:33.088400 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0bafbdff-91ca-4198-9bd0-cf63e94dc7b7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:33.223159 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-0bafbdff-91ca-4198-9bd0-cf63e94dc7b7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:33.230981 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-0bafbdff-91ca-4198-9bd0-cf63e94dc7b7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:33.233128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-0bafbdff-91ca-4198-9bd0-cf63e94dc7b7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:33.234365 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-0bafbdff-91ca-4198-9bd0-cf63e94dc7b7 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1407 microversion: 2.20 time: 0.158848 May 12 11:49:33.234933 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 313/621] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:49:33 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:49:33.556361 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-0b2dc00c-6789-47e8-bb44-1d1440c611ee tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:33.557287 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-0b2dc00c-6789-47e8-bb44-1d1440c611ee tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:33.563886 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0b2dc00c-6789-47e8-bb44-1d1440c611ee tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:33.564336 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0b2dc00c-6789-47e8-bb44-1d1440c611ee tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:33.565100 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0b2dc00c-6789-47e8-bb44-1d1440c611ee tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:33.565538 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0b2dc00c-6789-47e8-bb44-1d1440c611ee tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:33.593549 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-0b2dc00c-6789-47e8-bb44-1d1440c611ee tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041165 May 12 11:49:33.594138 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 314/622] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 12 11:49:33 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:49:34.139484 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-2210018c-2b5a-45f8-b59d-519deb19e48f tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "POST /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.576855 May 12 11:49:34.140532 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 309/623] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 12 11:49:32 2022] POST /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a/os-volume_attachments => generated 194 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:49:34.252340 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-07dd4d49-dd8b-49dc-88f6-0740fd218c02 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:34.253045 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-07dd4d49-dd8b-49dc-88f6-0740fd218c02 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:34.259387 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-07dd4d49-dd8b-49dc-88f6-0740fd218c02 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:34.259834 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-07dd4d49-dd8b-49dc-88f6-0740fd218c02 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:34.260599 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-07dd4d49-dd8b-49dc-88f6-0740fd218c02 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:34.261035 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-07dd4d49-dd8b-49dc-88f6-0740fd218c02 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:34.388207 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-07dd4d49-dd8b-49dc-88f6-0740fd218c02 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:34.397503 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-07dd4d49-dd8b-49dc-88f6-0740fd218c02 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:34.399439 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-07dd4d49-dd8b-49dc-88f6-0740fd218c02 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:34.400565 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-07dd4d49-dd8b-49dc-88f6-0740fd218c02 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1407 microversion: 2.20 time: 0.152470 May 12 11:49:34.401136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 315/624] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:49:34 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:49:34.606036 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-d741da09-5570-4818-85ec-189fc2647899 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:34.607260 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d741da09-5570-4818-85ec-189fc2647899 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:34.613509 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d741da09-5570-4818-85ec-189fc2647899 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:34.614063 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d741da09-5570-4818-85ec-189fc2647899 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:34.614900 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d741da09-5570-4818-85ec-189fc2647899 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:34.615340 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d741da09-5570-4818-85ec-189fc2647899 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:34.643247 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-d741da09-5570-4818-85ec-189fc2647899 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041939 May 12 11:49:34.643814 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 310/625] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 12 11:49:34 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 11:49:34.654096 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-be486fcc-a093-418f-8217-be1d39d80664 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:34.654594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-be486fcc-a093-418f-8217-be1d39d80664 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:34.660431 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-be486fcc-a093-418f-8217-be1d39d80664 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:34.660877 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-be486fcc-a093-418f-8217-be1d39d80664 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:34.661643 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-be486fcc-a093-418f-8217-be1d39d80664 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:34.662116 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-be486fcc-a093-418f-8217-be1d39d80664 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:34.734250 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-be486fcc-a093-418f-8217-be1d39d80664 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] HTTP exception thrown: Instance 3a03ef4f-9cf8-4749-8eb8-9077d5987909 is not attached to volume ea034f2b-de66-41f3-ba33-d015d67222d0 May 12 11:49:34.748411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-be486fcc-a093-418f-8217-be1d39d80664 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Request method failure captured: May 12 11:49:34.748411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: DELETE /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909/os-volume_attachments/ea034f2b-de66-41f3-ba33-d015d67222d0 HTTP/1.1 May 12 11:49:34.748411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:49:34.748411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:49:34.748411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:49:34.748411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:49:34.748411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:49:34.748411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:49:34.748411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:49:34.748411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:49:34.748411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPONKC0K9bWN-zuFIBGic4PZrKhhoHS_R7hBAJxTmdqVLl-jrjN_W2C0TgEtyDl_nfooBTS_qTX9noqZfLRlwm-IkqRHPkal9dsyr5stFSGhP0mdl2cRNCmlF9ttujMnEab3BvdzhUUi0D0tP3VfLIev0GIv2BLeWCabkR2O95otifc May 12 11:49:34.748411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:49:34.748411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:49:34.748411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:49:34.748411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:49:34.748411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:49:34.748411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:49:34.748411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: 95636bf5a2284bc697044d2b3b46828a May 12 11:49:34.748411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-TestMinimumBasicScenario-552713529 May 12 11:49:34.748411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:49:34.748411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:49:34.749946 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/95636bf5a2284bc697044d2b3b46828a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/95636bf5a2284bc697044d2b3b46828a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/95636bf5a2284bc697044d2b3b46828a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_95636bf5a2284bc697044d2b3b46828a", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:49:34.749946 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-TestMinimumBasicScenario-552713529 May 12 11:49:34.749946 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: 95636bf5a2284bc697044d2b3b46828a May 12 11:49:34.749946 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-TestMinimumBasicScenario-552713529 May 12 11:49:34.749946 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-TestMinimumBasicScenario-552713529-project May 12 11:49:34.749946 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:49:34.749946 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:49:34.749946 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 59c0922d8e2f4389a3aa4b6daa9d3d37 May 12 11:49:34.749946 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-TestMinimumBasicScenario-552713529-project May 12 11:49:34.749946 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:49:34.749946 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance 3a03ef4f-9cf8-4749-8eb8-9077d5987909 is not attached to volume ea034f2b-de66-41f3-ba33-d015d67222d0 May 12 11:49:34.750648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'server_id': '3a03ef4f-9cf8-4749-8eb8-9077d5987909', 'id': 'ea034f2b-de66-41f3-ba33-d015d67222d0'} May 12 11:49:34.750648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:49:34.750648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:49:34.750648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 12 11:49:34.750648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 12 11:49:34.750648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 11:49:34.750648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 11:49:34.750648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 12 11:49:34.750648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 12 11:49:34.750648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ea034f2b-de66-41f3-ba33-d015d67222d0. May 12 11:49:34.750648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:49:34.750648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:49:34.750648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:49:34.750648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:49:34.750648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:49:34.750648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:49:34.750648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:49:34.750648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:49:34.750648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:49:34.751817 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:49:34.751817 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 12 11:49:34.751817 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 12 11:49:34.751817 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a03ef4f-9cf8-4749-8eb8-9077d5987909 is not attached to volume ea034f2b-de66-41f3-ba33-d015d67222d0 May 12 11:49:34.751817 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:49:34.751817 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:49:34.751817 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:49:34.751817 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:49:34.751817 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:49:34.751817 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:49:34.751817 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:49:34.751817 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:49:34.751817 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a03ef4f-9cf8-4749-8eb8-9077d5987909 is not attached to volume ea034f2b-de66-41f3-ba33-d015d67222d0 May 12 11:49:34.751817 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:49:34.751817 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-be486fcc-a093-418f-8217-be1d39d80664 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Returning 404 to user: Instance 3a03ef4f-9cf8-4749-8eb8-9077d5987909 is not attached to volume ea034f2b-de66-41f3-ba33-d015d67222d0 {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:49:34.752716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-be486fcc-a093-418f-8217-be1d39d80664 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909/os-volume_attachments/ea034f2b-de66-41f3-ba33-d015d67222d0" status: 404 len: 154 microversion: 2.1 time: 0.100255 May 12 11:49:34.752716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 316/626] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 12 11:49:34 2022] DELETE /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909/os-volume_attachments/ea034f2b-de66-41f3-ba33-d015d67222d0 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:49:35.418800 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-b98a523d-b326-4218-ab63-268c27c8f0f0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:35.419307 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-b98a523d-b326-4218-ab63-268c27c8f0f0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:35.425615 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b98a523d-b326-4218-ab63-268c27c8f0f0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:35.426098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b98a523d-b326-4218-ab63-268c27c8f0f0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:35.426871 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b98a523d-b326-4218-ab63-268c27c8f0f0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:35.427310 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b98a523d-b326-4218-ab63-268c27c8f0f0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:35.555321 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b98a523d-b326-4218-ab63-268c27c8f0f0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:35.563596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b98a523d-b326-4218-ab63-268c27c8f0f0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:35.565105 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b98a523d-b326-4218-ab63-268c27c8f0f0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:35.566254 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-b98a523d-b326-4218-ab63-268c27c8f0f0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1407 microversion: 2.20 time: 0.151402 May 12 11:49:35.566818 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 311/627] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:49:35 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:49:35.884424 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-deb67176-9366-486c-b968-d8b40e182aad tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:35.884939 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-deb67176-9366-486c-b968-d8b40e182aad tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:35.891479 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-deb67176-9366-486c-b968-d8b40e182aad tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:35.891935 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-deb67176-9366-486c-b968-d8b40e182aad tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:35.892715 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-deb67176-9366-486c-b968-d8b40e182aad tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:35.893160 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-deb67176-9366-486c-b968-d8b40e182aad tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:35.917327 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-deb67176-9366-486c-b968-d8b40e182aad tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Going to try to terminate instance {{(pid=123508) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 11:49:35.993452 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-deb67176-9366-486c-b968-d8b40e182aad tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 204 len: 0 microversion: 2.1 time: 0.112513 May 12 11:49:35.994418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 317/628] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:49:35 2022] DELETE /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 11:49:36.003247 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-b1dffbcd-23f2-429a-8124-c93b805fe484 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:36.003899 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-b1dffbcd-23f2-429a-8124-c93b805fe484 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:36.009976 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b1dffbcd-23f2-429a-8124-c93b805fe484 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:36.010430 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b1dffbcd-23f2-429a-8124-c93b805fe484 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:36.011213 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b1dffbcd-23f2-429a-8124-c93b805fe484 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:36.011653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b1dffbcd-23f2-429a-8124-c93b805fe484 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:36.136252 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b1dffbcd-23f2-429a-8124-c93b805fe484 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:36.143469 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-b1dffbcd-23f2-429a-8124-c93b805fe484 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1552 microversion: 2.1 time: 0.144194 May 12 11:49:36.144042 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 312/629] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:35 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1552 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:36.585172 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-f77b7fce-3e1c-4fe3-b0b3-1f4a5b45961e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:36.585901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-f77b7fce-3e1c-4fe3-b0b3-1f4a5b45961e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:36.591952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f77b7fce-3e1c-4fe3-b0b3-1f4a5b45961e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:36.592344 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f77b7fce-3e1c-4fe3-b0b3-1f4a5b45961e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:36.593110 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f77b7fce-3e1c-4fe3-b0b3-1f4a5b45961e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:36.593547 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f77b7fce-3e1c-4fe3-b0b3-1f4a5b45961e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:36.721601 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-f77b7fce-3e1c-4fe3-b0b3-1f4a5b45961e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:36.729285 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-f77b7fce-3e1c-4fe3-b0b3-1f4a5b45961e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:36.730823 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-f77b7fce-3e1c-4fe3-b0b3-1f4a5b45961e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:36.732439 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-f77b7fce-3e1c-4fe3-b0b3-1f4a5b45961e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1407 microversion: 2.20 time: 0.151485 May 12 11:49:36.732997 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 318/630] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:49:36 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:49:37.161357 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-d70d63e0-2c2f-4442-b7df-4711a27dcf36 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:37.161988 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d70d63e0-2c2f-4442-b7df-4711a27dcf36 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:37.168259 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d70d63e0-2c2f-4442-b7df-4711a27dcf36 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:37.168740 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d70d63e0-2c2f-4442-b7df-4711a27dcf36 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:37.169474 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d70d63e0-2c2f-4442-b7df-4711a27dcf36 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:37.169937 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d70d63e0-2c2f-4442-b7df-4711a27dcf36 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:37.299058 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-d70d63e0-2c2f-4442-b7df-4711a27dcf36 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:37.306357 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-d70d63e0-2c2f-4442-b7df-4711a27dcf36 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1552 microversion: 2.1 time: 0.148656 May 12 11:49:37.307243 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 313/631] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:37 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:37.750818 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-3bf681be-8cf4-4463-ad34-8f47619ee828 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:37.751428 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-3bf681be-8cf4-4463-ad34-8f47619ee828 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:37.757962 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3bf681be-8cf4-4463-ad34-8f47619ee828 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:37.758458 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3bf681be-8cf4-4463-ad34-8f47619ee828 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:37.759241 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3bf681be-8cf4-4463-ad34-8f47619ee828 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:37.759683 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3bf681be-8cf4-4463-ad34-8f47619ee828 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:37.887049 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-3bf681be-8cf4-4463-ad34-8f47619ee828 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:37.895488 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-3bf681be-8cf4-4463-ad34-8f47619ee828 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:37.896987 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-3bf681be-8cf4-4463-ad34-8f47619ee828 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:37.898118 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-3bf681be-8cf4-4463-ad34-8f47619ee828 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1407 microversion: 2.20 time: 0.151678 May 12 11:49:37.898930 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 319/632] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:49:37 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:49:37.943908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-f041a625-06d0-4369-8524-4aaee8529555 req-cf2b8509-c457-40f2-868e-b4dca6edde6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efbc8e04-31bd-4238-8c9a-096ad87a46ab", "name": "network-vif-plugged", "status": "completed", "tag": "e62c63ee-3f94-4556-b00c-c45c7465fd0e"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:49:37.953170 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-f041a625-06d0-4369-8524-4aaee8529555 req-cf2b8509-c457-40f2-868e-b4dca6edde6a service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:37.953615 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-f041a625-06d0-4369-8524-4aaee8529555 req-cf2b8509-c457-40f2-868e-b4dca6edde6a service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:37.965079 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-f041a625-06d0-4369-8524-4aaee8529555 req-cf2b8509-c457-40f2-868e-b4dca6edde6a service nova] Creating event network-vif-plugged:e62c63ee-3f94-4556-b00c-c45c7465fd0e for instance efbc8e04-31bd-4238-8c9a-096ad87a46ab on hv-cinder-80473 May 12 11:49:37.970370 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-f041a625-06d0-4369-8524-4aaee8529555 req-cf2b8509-c457-40f2-868e-b4dca6edde6a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030250 May 12 11:49:37.971169 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 314/633] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:49:38.324029 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-9212a0fd-3664-4fd8-bfa8-720fe1718df1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:38.324733 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-9212a0fd-3664-4fd8-bfa8-720fe1718df1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:38.331309 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9212a0fd-3664-4fd8-bfa8-720fe1718df1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:38.331870 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9212a0fd-3664-4fd8-bfa8-720fe1718df1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:38.332719 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9212a0fd-3664-4fd8-bfa8-720fe1718df1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:38.333235 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9212a0fd-3664-4fd8-bfa8-720fe1718df1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:38.467879 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-9212a0fd-3664-4fd8-bfa8-720fe1718df1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:38.475407 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-9212a0fd-3664-4fd8-bfa8-720fe1718df1 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1552 microversion: 2.1 time: 0.155051 May 12 11:49:38.476235 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 320/634] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:38 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:38.617970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-4507ebad-e64a-465e-a543-c682309c9af0 req-91dfd20d-97ac-4ef7-99b9-37e74a1069c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a03ef4f-9cf8-4749-8eb8-9077d5987909", "name": "network-vif-deleted", "tag": "5467d5f0-8b8e-4bbd-967c-8638230e171e"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:49:38.626525 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-4507ebad-e64a-465e-a543-c682309c9af0 req-91dfd20d-97ac-4ef7-99b9-37e74a1069c6 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:38.626981 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-4507ebad-e64a-465e-a543-c682309c9af0 req-91dfd20d-97ac-4ef7-99b9-37e74a1069c6 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:38.638866 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-4507ebad-e64a-465e-a543-c682309c9af0 req-91dfd20d-97ac-4ef7-99b9-37e74a1069c6 service nova] Creating event network-vif-deleted:5467d5f0-8b8e-4bbd-967c-8638230e171e for instance 3a03ef4f-9cf8-4749-8eb8-9077d5987909 on hv-cinder-80473 May 12 11:49:38.643592 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-4507ebad-e64a-465e-a543-c682309c9af0 req-91dfd20d-97ac-4ef7-99b9-37e74a1069c6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029724 May 12 11:49:38.644162 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 315/635] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:49:38.915905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-c628c8cd-4420-4441-bd3b-d458d10a795e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:38.916520 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-c628c8cd-4420-4441-bd3b-d458d10a795e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:38.923078 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c628c8cd-4420-4441-bd3b-d458d10a795e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:38.923533 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c628c8cd-4420-4441-bd3b-d458d10a795e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:38.924315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c628c8cd-4420-4441-bd3b-d458d10a795e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:38.924751 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c628c8cd-4420-4441-bd3b-d458d10a795e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:39.054402 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c628c8cd-4420-4441-bd3b-d458d10a795e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:39.062049 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c628c8cd-4420-4441-bd3b-d458d10a795e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:39.063540 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c628c8cd-4420-4441-bd3b-d458d10a795e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:39.064625 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-c628c8cd-4420-4441-bd3b-d458d10a795e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1407 microversion: 2.20 time: 0.152710 May 12 11:49:39.065182 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 321/636] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:49:38 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:49:39.492691 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-f13d1610-c505-4197-8b0a-943dfe8ab2e0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:39.493392 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-f13d1610-c505-4197-8b0a-943dfe8ab2e0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:39.499581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f13d1610-c505-4197-8b0a-943dfe8ab2e0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:39.500029 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f13d1610-c505-4197-8b0a-943dfe8ab2e0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:39.500795 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f13d1610-c505-4197-8b0a-943dfe8ab2e0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:39.501238 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f13d1610-c505-4197-8b0a-943dfe8ab2e0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:39.531449 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f13d1610-c505-4197-8b0a-943dfe8ab2e0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:39.531882 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f13d1610-c505-4197-8b0a-943dfe8ab2e0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:39.532317 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.objects.instance [None req-f13d1610-c505-4197-8b0a-943dfe8ab2e0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lazy-loading 'fault' on Instance uuid 3a03ef4f-9cf8-4749-8eb8-9077d5987909 {{(pid=123507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:49:39.575193 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-f13d1610-c505-4197-8b0a-943dfe8ab2e0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c0922d8e2f4389a3aa4b6daa9d3d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95636bf5a2284bc697044d2b3b46828a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:39.583330 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-f13d1610-c505-4197-8b0a-943dfe8ab2e0 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 200 len: 1348 microversion: 2.1 time: 0.094748 May 12 11:49:39.583894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 316/637] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:39 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 1348 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:40.082958 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-70aa5465-4177-4c04-98fd-c4a78a6aadde tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:40.083466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-70aa5465-4177-4c04-98fd-c4a78a6aadde tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:40.089680 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-70aa5465-4177-4c04-98fd-c4a78a6aadde tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:40.090183 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-70aa5465-4177-4c04-98fd-c4a78a6aadde tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:40.090938 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-70aa5465-4177-4c04-98fd-c4a78a6aadde tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:40.091371 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-70aa5465-4177-4c04-98fd-c4a78a6aadde tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:40.216660 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-70aa5465-4177-4c04-98fd-c4a78a6aadde tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:40.224278 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-70aa5465-4177-4c04-98fd-c4a78a6aadde tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:40.225820 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-70aa5465-4177-4c04-98fd-c4a78a6aadde tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:40.226971 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-70aa5465-4177-4c04-98fd-c4a78a6aadde tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1598 microversion: 2.20 time: 0.147909 May 12 11:49:40.227537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 322/638] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:49:40 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1598 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:49:40.244262 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-3f072c55-a97f-4395-b55c-61fa04f48a92 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:40.244795 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-3f072c55-a97f-4395-b55c-61fa04f48a92 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:40.251847 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3f072c55-a97f-4395-b55c-61fa04f48a92 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:40.252299 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3f072c55-a97f-4395-b55c-61fa04f48a92 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:40.253081 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3f072c55-a97f-4395-b55c-61fa04f48a92 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:40.253518 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3f072c55-a97f-4395-b55c-61fa04f48a92 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:40.330831 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-3f072c55-a97f-4395-b55c-61fa04f48a92 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090305 May 12 11:49:40.331433 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 317/639] 10.222.0.58 () {60 vars in 1315 bytes} [Thu May 12 11:49:40 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 11:49:40.603499 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-49b82350-f466-4abb-9537-ae8a5811939f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:40.603499 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-49b82350-f466-4abb-9537-ae8a5811939f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] [instance: 3a03ef4f-9cf8-4749-8eb8-9077d5987909] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:40.607582 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-49b82350-f466-4abb-9537-ae8a5811939f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:40.608104 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-49b82350-f466-4abb-9537-ae8a5811939f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:40.609471 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-49b82350-f466-4abb-9537-ae8a5811939f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:40.609946 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-49b82350-f466-4abb-9537-ae8a5811939f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:40.623109 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-49b82350-f466-4abb-9537-ae8a5811939f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] HTTP exception thrown: Instance 3a03ef4f-9cf8-4749-8eb8-9077d5987909 could not be found. May 12 11:49:40.625312 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-49b82350-f466-4abb-9537-ae8a5811939f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Request method failure captured: May 12 11:49:40.625312 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 HTTP/1.1 May 12 11:49:40.625312 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:49:40.625312 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:49:40.625312 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:49:40.625312 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:49:40.625312 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:49:40.625312 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:49:40.625312 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:49:40.625312 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:49:40.625312 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPONKC0K9bWN-zuFIBGic4PZrKhhoHS_R7hBAJxTmdqVLl-jrjN_W2C0TgEtyDl_nfooBTS_qTX9noqZfLRlwm-IkqRHPkal9dsyr5stFSGhP0mdl2cRNCmlF9ttujMnEab3BvdzhUUi0D0tP3VfLIev0GIv2BLeWCabkR2O95otifc May 12 11:49:40.625312 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:49:40.625312 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:49:40.625312 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:49:40.625312 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:49:40.625312 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:49:40.625312 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:49:40.625312 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: 95636bf5a2284bc697044d2b3b46828a May 12 11:49:40.625312 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-TestMinimumBasicScenario-552713529 May 12 11:49:40.625312 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:49:40.625312 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:49:40.626914 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/95636bf5a2284bc697044d2b3b46828a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/95636bf5a2284bc697044d2b3b46828a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/95636bf5a2284bc697044d2b3b46828a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_95636bf5a2284bc697044d2b3b46828a", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:49:40.626914 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-TestMinimumBasicScenario-552713529 May 12 11:49:40.626914 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: 95636bf5a2284bc697044d2b3b46828a May 12 11:49:40.626914 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-TestMinimumBasicScenario-552713529 May 12 11:49:40.626914 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-TestMinimumBasicScenario-552713529-project May 12 11:49:40.626914 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:49:40.626914 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:49:40.626914 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 59c0922d8e2f4389a3aa4b6daa9d3d37 May 12 11:49:40.626914 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-TestMinimumBasicScenario-552713529-project May 12 11:49:40.626914 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:49:40.626914 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance 3a03ef4f-9cf8-4749-8eb8-9077d5987909 could not be found. May 12 11:49:40.626914 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': '3a03ef4f-9cf8-4749-8eb8-9077d5987909'} May 12 11:49:40.627842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:49:40.627842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:49:40.627842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:49:40.627842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:49:40.627842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:49:40.627842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:49:40.627842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:49:40.627842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:49:40.627842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:49:40.627842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:49:40.627842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a03ef4f-9cf8-4749-8eb8-9077d5987909 could not be found. May 12 11:49:40.627842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:49:40.627842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:49:40.627842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:49:40.627842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:49:40.627842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:49:40.627842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:49:40.627842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:49:40.627842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:49:40.627842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:49:40.629256 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:49:40.629256 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:49:40.629256 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:49:40.629256 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:49:40.629256 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:49:40.629256 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:49:40.629256 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:49:40.629256 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a03ef4f-9cf8-4749-8eb8-9077d5987909 could not be found. May 12 11:49:40.629256 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:49:40.629256 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:49:40.629256 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:49:40.629256 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:49:40.629256 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:49:40.629256 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:49:40.629256 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:49:40.629256 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:49:40.629256 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a03ef4f-9cf8-4749-8eb8-9077d5987909 could not be found. May 12 11:49:40.629256 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:49:40.630947 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-49b82350-f466-4abb-9537-ae8a5811939f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Returning 404 to user: Instance 3a03ef4f-9cf8-4749-8eb8-9077d5987909 could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:49:40.630947 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-49b82350-f466-4abb-9537-ae8a5811939f tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909" status: 404 len: 111 microversion: 2.1 time: 0.030272 May 12 11:49:40.630947 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 323/640] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:40 2022] GET /compute/v2.1/servers/3a03ef4f-9cf8-4749-8eb8-9077d5987909 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:49:40.636094 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-813c4904-d7e6-4d4a-a118-4a414cea1488 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] Calling method '.version_select at 0x7f29f1d630d0>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:40.653776 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-813c4904-d7e6-4d4a-a118-4a414cea1488 tempest-TestMinimumBasicScenario-552713529 tempest-TestMinimumBasicScenario-552713529-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-466760655" status: 202 len: 0 microversion: 2.1 time: 0.021360 May 12 11:49:40.654360 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 318/641] 10.222.0.58 () {58 vars in 1268 bytes} [Thu May 12 11:49:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-466760655 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:49:41.587196 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-7f4f4184-1fea-4779-a74b-1e5e80bb20be req-9b6d775b-4254-42ff-9fc0-52b9e6f00ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efbc8e04-31bd-4238-8c9a-096ad87a46ab", "tag": "e62c63ee-3f94-4556-b00c-c45c7465fd0e"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:49:41.596134 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-7f4f4184-1fea-4779-a74b-1e5e80bb20be req-9b6d775b-4254-42ff-9fc0-52b9e6f00ce7 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:41.596592 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-7f4f4184-1fea-4779-a74b-1e5e80bb20be req-9b6d775b-4254-42ff-9fc0-52b9e6f00ce7 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:41.615087 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-7f4f4184-1fea-4779-a74b-1e5e80bb20be req-9b6d775b-4254-42ff-9fc0-52b9e6f00ce7 service nova] Creating event network-changed:e62c63ee-3f94-4556-b00c-c45c7465fd0e for instance efbc8e04-31bd-4238-8c9a-096ad87a46ab on hv-cinder-80473 May 12 11:49:41.620145 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-7f4f4184-1fea-4779-a74b-1e5e80bb20be req-9b6d775b-4254-42ff-9fc0-52b9e6f00ce7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037041 May 12 11:49:41.621388 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 324/642] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:49:46.947621 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-91a30dc5-a392-40e7-bf2d-8e14c5a6bd99 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:46.948131 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-91a30dc5-a392-40e7-bf2d-8e14c5a6bd99 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:46.955165 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-91a30dc5-a392-40e7-bf2d-8e14c5a6bd99 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:46.955620 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-91a30dc5-a392-40e7-bf2d-8e14c5a6bd99 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:46.956424 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-91a30dc5-a392-40e7-bf2d-8e14c5a6bd99 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:46.956866 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-91a30dc5-a392-40e7-bf2d-8e14c5a6bd99 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:47.038129 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.objects.instance [None req-91a30dc5-a392-40e7-bf2d-8e14c5a6bd99 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lazy-loading 'services' on Instance uuid f609a10d-385a-4eb7-92b3-cfd766e53d22 {{(pid=123507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:49:47.114580 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-91a30dc5-a392-40e7-bf2d-8e14c5a6bd99 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22/os-volume_attachments/244b7dcc-8b0f-4eed-b4fd-b340a1811947" status: 202 len: 0 microversion: 2.1 time: 0.171062 May 12 11:49:47.115710 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 319/643] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 12 11:49:46 2022] DELETE /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22/os-volume_attachments/244b7dcc-8b0f-4eed-b4fd-b340a1811947 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:49:47.124919 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ba0d2de3-82e1-4cda-8989-fe5dcde14cf3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:47.126065 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-ba0d2de3-82e1-4cda-8989-fe5dcde14cf3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:47.133039 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ba0d2de3-82e1-4cda-8989-fe5dcde14cf3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:47.133573 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ba0d2de3-82e1-4cda-8989-fe5dcde14cf3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:47.134539 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ba0d2de3-82e1-4cda-8989-fe5dcde14cf3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:47.135256 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ba0d2de3-82e1-4cda-8989-fe5dcde14cf3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:47.170855 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-ba0d2de3-82e1-4cda-8989-fe5dcde14cf3 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050895 May 12 11:49:47.171475 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 325/644] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 12 11:49:47 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:49:48.185467 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-58e70393-9a60-4dc3-bcf7-fd6e3e87684f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:48.186579 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-58e70393-9a60-4dc3-bcf7-fd6e3e87684f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:48.193144 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-58e70393-9a60-4dc3-bcf7-fd6e3e87684f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:48.193594 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-58e70393-9a60-4dc3-bcf7-fd6e3e87684f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:48.194387 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-58e70393-9a60-4dc3-bcf7-fd6e3e87684f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:48.195005 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-58e70393-9a60-4dc3-bcf7-fd6e3e87684f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:48.223802 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-58e70393-9a60-4dc3-bcf7-fd6e3e87684f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043510 May 12 11:49:48.224363 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 320/645] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 12 11:49:48 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:49:49.239612 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-01fbf6cd-8987-4dac-8ddf-917ed6db969f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:49.240585 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-01fbf6cd-8987-4dac-8ddf-917ed6db969f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:49.247464 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-01fbf6cd-8987-4dac-8ddf-917ed6db969f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:49.247842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-01fbf6cd-8987-4dac-8ddf-917ed6db969f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:49.248664 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-01fbf6cd-8987-4dac-8ddf-917ed6db969f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:49.249140 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-01fbf6cd-8987-4dac-8ddf-917ed6db969f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:49.282933 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-01fbf6cd-8987-4dac-8ddf-917ed6db969f tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050433 May 12 11:49:49.283507 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 326/646] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 12 11:49:49 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:49:50.295013 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-8a97e6ee-183a-4d5c-8718-465b60b2bbb2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:50.296101 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-8a97e6ee-183a-4d5c-8718-465b60b2bbb2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:50.302507 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8a97e6ee-183a-4d5c-8718-465b60b2bbb2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:50.303205 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8a97e6ee-183a-4d5c-8718-465b60b2bbb2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:50.304060 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8a97e6ee-183a-4d5c-8718-465b60b2bbb2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:50.304686 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8a97e6ee-183a-4d5c-8718-465b60b2bbb2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:50.334146 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-8a97e6ee-183a-4d5c-8718-465b60b2bbb2 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043289 May 12 11:49:50.335107 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 321/647] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 12 11:49:50 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 11:49:50.429528 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-95adcabb-5ab1-4b58-b854-e9071f492396 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:50.430138 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-95adcabb-5ab1-4b58-b854-e9071f492396 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:50.436442 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-95adcabb-5ab1-4b58-b854-e9071f492396 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:50.437791 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-95adcabb-5ab1-4b58-b854-e9071f492396 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:50.438660 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-95adcabb-5ab1-4b58-b854-e9071f492396 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:50.439265 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-95adcabb-5ab1-4b58-b854-e9071f492396 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:50.471962 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-95adcabb-5ab1-4b58-b854-e9071f492396 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Going to try to terminate instance {{(pid=123508) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 11:49:50.568384 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-95adcabb-5ab1-4b58-b854-e9071f492396 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 204 len: 0 microversion: 2.1 time: 0.142547 May 12 11:49:50.569237 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 327/648] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:49:50 2022] DELETE /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 11:49:50.578519 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-daa14b8e-d1d4-497a-8ef2-2e5657c7c687 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:50.579327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-daa14b8e-d1d4-497a-8ef2-2e5657c7c687 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:50.585934 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-daa14b8e-d1d4-497a-8ef2-2e5657c7c687 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:50.587404 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-daa14b8e-d1d4-497a-8ef2-2e5657c7c687 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:50.588306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-daa14b8e-d1d4-497a-8ef2-2e5657c7c687 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:50.588820 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-daa14b8e-d1d4-497a-8ef2-2e5657c7c687 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:50.733575 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-daa14b8e-d1d4-497a-8ef2-2e5657c7c687 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:50.741532 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-daa14b8e-d1d4-497a-8ef2-2e5657c7c687 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1689 microversion: 2.1 time: 0.167947 May 12 11:49:50.751672 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 322/649] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:50 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:49:51.759997 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-0911cf00-0f8a-4534-beb6-9208725c4f72 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:51.761456 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-0911cf00-0f8a-4534-beb6-9208725c4f72 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:51.768472 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0911cf00-0f8a-4534-beb6-9208725c4f72 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:51.768931 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0911cf00-0f8a-4534-beb6-9208725c4f72 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:51.769784 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0911cf00-0f8a-4534-beb6-9208725c4f72 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:51.771205 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0911cf00-0f8a-4534-beb6-9208725c4f72 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:51.927154 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-0911cf00-0f8a-4534-beb6-9208725c4f72 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:51.936314 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-0911cf00-0f8a-4534-beb6-9208725c4f72 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1689 microversion: 2.1 time: 0.180571 May 12 11:49:51.945648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 328/650] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:51 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1689 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:49:52.954587 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-af02c58a-0b78-4d68-a164-fdec1e368fe0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:52.955180 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-af02c58a-0b78-4d68-a164-fdec1e368fe0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:52.962742 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-af02c58a-0b78-4d68-a164-fdec1e368fe0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:52.963193 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-af02c58a-0b78-4d68-a164-fdec1e368fe0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:52.963973 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-af02c58a-0b78-4d68-a164-fdec1e368fe0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:52.964410 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-af02c58a-0b78-4d68-a164-fdec1e368fe0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:53.197375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-af02c58a-0b78-4d68-a164-fdec1e368fe0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:53.207861 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-af02c58a-0b78-4d68-a164-fdec1e368fe0 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1689 microversion: 2.1 time: 0.258982 May 12 11:49:53.211283 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 323/651] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:52 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1689 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:53.519381 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-65a77551-a7c7-456c-ba5b-c93e73a56ac4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:53.520496 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-65a77551-a7c7-456c-ba5b-c93e73a56ac4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: ba6039b3-958e-46ef-83e3-a942c113b22a] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:53.527053 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-65a77551-a7c7-456c-ba5b-c93e73a56ac4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:53.527726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-65a77551-a7c7-456c-ba5b-c93e73a56ac4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:53.528717 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-65a77551-a7c7-456c-ba5b-c93e73a56ac4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:53.529388 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-65a77551-a7c7-456c-ba5b-c93e73a56ac4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:53.616384 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.objects.instance [None req-65a77551-a7c7-456c-ba5b-c93e73a56ac4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lazy-loading 'services' on Instance uuid ba6039b3-958e-46ef-83e3-a942c113b22a {{(pid=123508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:49:53.747506 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-65a77551-a7c7-456c-ba5b-c93e73a56ac4 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a/os-volume_attachments/2d7b44df-8edb-4506-8ae9-b05fb0a0670f" status: 202 len: 0 microversion: 2.1 time: 0.232081 May 12 11:49:53.748402 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 329/652] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 12 11:49:53 2022] DELETE /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a/os-volume_attachments/2d7b44df-8edb-4506-8ae9-b05fb0a0670f => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:49:54.226938 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-3925f09c-6ee3-40f3-b54b-8b2e07ec836c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:54.227560 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-3925f09c-6ee3-40f3-b54b-8b2e07ec836c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:54.246154 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3925f09c-6ee3-40f3-b54b-8b2e07ec836c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:54.246939 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3925f09c-6ee3-40f3-b54b-8b2e07ec836c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:54.248709 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3925f09c-6ee3-40f3-b54b-8b2e07ec836c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:54.249909 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3925f09c-6ee3-40f3-b54b-8b2e07ec836c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:54.513279 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-3925f09c-6ee3-40f3-b54b-8b2e07ec836c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:54.521884 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-3925f09c-6ee3-40f3-b54b-8b2e07ec836c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1689 microversion: 2.1 time: 0.300621 May 12 11:49:54.526087 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 324/653] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:54 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1689 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:55.544266 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-31714c8f-ecf2-4a20-b154-ac28c6352875 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:55.545872 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-31714c8f-ecf2-4a20-b154-ac28c6352875 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:55.552243 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-31714c8f-ecf2-4a20-b154-ac28c6352875 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:55.553180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-31714c8f-ecf2-4a20-b154-ac28c6352875 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:55.554352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-31714c8f-ecf2-4a20-b154-ac28c6352875 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:55.554786 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-31714c8f-ecf2-4a20-b154-ac28c6352875 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:55.990295 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-4b3eb126-fed3-4c7f-9abc-f2c0dd83cefc tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:55.991356 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-4b3eb126-fed3-4c7f-9abc-f2c0dd83cefc tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: ba6039b3-958e-46ef-83e3-a942c113b22a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:56.000180 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4b3eb126-fed3-4c7f-9abc-f2c0dd83cefc tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:56.002197 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4b3eb126-fed3-4c7f-9abc-f2c0dd83cefc tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:56.004995 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4b3eb126-fed3-4c7f-9abc-f2c0dd83cefc tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:56.007267 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4b3eb126-fed3-4c7f-9abc-f2c0dd83cefc tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:56.026224 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-31714c8f-ecf2-4a20-b154-ac28c6352875 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:56.036599 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-31714c8f-ecf2-4a20-b154-ac28c6352875 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1689 microversion: 2.1 time: 0.496919 May 12 11:49:56.037531 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 330/654] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:55 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1689 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:56.044176 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-4b3eb126-fed3-4c7f-9abc-f2c0dd83cefc tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: ba6039b3-958e-46ef-83e3-a942c113b22a] Going to try to terminate instance {{(pid=123507) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 11:49:56.133475 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-4b3eb126-fed3-4c7f-9abc-f2c0dd83cefc tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a" status: 204 len: 0 microversion: 2.1 time: 0.149581 May 12 11:49:56.134310 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 325/655] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:49:55 2022] DELETE /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 11:49:56.143342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-e60505c8-48fd-419b-b16a-8def357d2485 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:56.143967 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-e60505c8-48fd-419b-b16a-8def357d2485 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: ba6039b3-958e-46ef-83e3-a942c113b22a] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:56.149867 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e60505c8-48fd-419b-b16a-8def357d2485 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:56.150510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e60505c8-48fd-419b-b16a-8def357d2485 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:56.151301 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e60505c8-48fd-419b-b16a-8def357d2485 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:56.151745 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e60505c8-48fd-419b-b16a-8def357d2485 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:56.313878 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-e60505c8-48fd-419b-b16a-8def357d2485 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:56.324135 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-e60505c8-48fd-419b-b16a-8def357d2485 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a" status: 200 len: 1513 microversion: 2.1 time: 0.185285 May 12 11:49:56.324999 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 331/656] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:56 2022] GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:56.998472 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-e3148e5b-bdaf-47bb-8494-958b1a5e6315 req-56b300a3-df92-4f91-a6c5-0fa66b7ac8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f609a10d-385a-4eb7-92b3-cfd766e53d22", "name": "network-vif-deleted", "tag": "2eb78bc7-7875-449d-a6e9-a6f8eebe488c"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:49:57.013786 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-e3148e5b-bdaf-47bb-8494-958b1a5e6315 req-56b300a3-df92-4f91-a6c5-0fa66b7ac8c4 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:57.014423 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-e3148e5b-bdaf-47bb-8494-958b1a5e6315 req-56b300a3-df92-4f91-a6c5-0fa66b7ac8c4 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:57.044185 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-e3148e5b-bdaf-47bb-8494-958b1a5e6315 req-56b300a3-df92-4f91-a6c5-0fa66b7ac8c4 service nova] Creating event network-vif-deleted:2eb78bc7-7875-449d-a6e9-a6f8eebe488c for instance f609a10d-385a-4eb7-92b3-cfd766e53d22 on hv-cinder-80473 May 12 11:49:57.053860 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-e3148e5b-bdaf-47bb-8494-958b1a5e6315 req-56b300a3-df92-4f91-a6c5-0fa66b7ac8c4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059721 May 12 11:49:57.055184 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-d6bde1d1-4c26-4e4f-bada-c9b698d1eaca tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:57.057391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d6bde1d1-4c26-4e4f-bada-c9b698d1eaca tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:57.059394 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 326/657] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:49:57.073835 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d6bde1d1-4c26-4e4f-bada-c9b698d1eaca tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:57.074427 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d6bde1d1-4c26-4e4f-bada-c9b698d1eaca tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:57.075490 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d6bde1d1-4c26-4e4f-bada-c9b698d1eaca tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:57.076148 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d6bde1d1-4c26-4e4f-bada-c9b698d1eaca tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:57.188111 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-d6bde1d1-4c26-4e4f-bada-c9b698d1eaca tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:57.198708 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-d6bde1d1-4c26-4e4f-bada-c9b698d1eaca tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1621 microversion: 2.1 time: 0.147895 May 12 11:49:57.200732 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 332/658] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:57 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1621 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:49:57.353841 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-b54b9cb8-c8e1-4f70-b3ba-4e6bffe4d22a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:57.356604 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-b54b9cb8-c8e1-4f70-b3ba-4e6bffe4d22a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: ba6039b3-958e-46ef-83e3-a942c113b22a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:57.369292 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b54b9cb8-c8e1-4f70-b3ba-4e6bffe4d22a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:57.371570 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b54b9cb8-c8e1-4f70-b3ba-4e6bffe4d22a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:57.372648 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b54b9cb8-c8e1-4f70-b3ba-4e6bffe4d22a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:57.378230 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b54b9cb8-c8e1-4f70-b3ba-4e6bffe4d22a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:57.673324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b54b9cb8-c8e1-4f70-b3ba-4e6bffe4d22a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:57.707502 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-b54b9cb8-c8e1-4f70-b3ba-4e6bffe4d22a tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a" status: 200 len: 1513 microversion: 2.1 time: 0.365853 May 12 11:49:57.718028 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 327/659] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:57 2022] GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a => generated 1513 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:58.219983 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-2812e1dc-a885-427c-a29b-31db597ddf5e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:58.221846 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-2812e1dc-a885-427c-a29b-31db597ddf5e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:58.233075 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2812e1dc-a885-427c-a29b-31db597ddf5e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:58.239213 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2812e1dc-a885-427c-a29b-31db597ddf5e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:58.240505 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2812e1dc-a885-427c-a29b-31db597ddf5e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:58.241163 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2812e1dc-a885-427c-a29b-31db597ddf5e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:58.309258 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2812e1dc-a885-427c-a29b-31db597ddf5e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:58.309728 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2812e1dc-a885-427c-a29b-31db597ddf5e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:58.310211 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.objects.instance [None req-2812e1dc-a885-427c-a29b-31db597ddf5e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lazy-loading 'fault' on Instance uuid f609a10d-385a-4eb7-92b3-cfd766e53d22 {{(pid=123508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:49:58.420106 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-2812e1dc-a885-427c-a29b-31db597ddf5e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:58.427637 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-2812e1dc-a885-427c-a29b-31db597ddf5e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 200 len: 1335 microversion: 2.1 time: 0.213658 May 12 11:49:58.433421 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 333/660] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:58 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 1335 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:58.725655 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-b5c104eb-b7e5-4bcc-8d8f-855a71f5506b tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:58.726455 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-b5c104eb-b7e5-4bcc-8d8f-855a71f5506b tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: ba6039b3-958e-46ef-83e3-a942c113b22a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:58.733007 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b5c104eb-b7e5-4bcc-8d8f-855a71f5506b tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:58.734197 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b5c104eb-b7e5-4bcc-8d8f-855a71f5506b tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:58.735208 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b5c104eb-b7e5-4bcc-8d8f-855a71f5506b tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:58.743345 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b5c104eb-b7e5-4bcc-8d8f-855a71f5506b tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:58.994497 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b5c104eb-b7e5-4bcc-8d8f-855a71f5506b tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:49:59.002945 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-b5c104eb-b7e5-4bcc-8d8f-855a71f5506b tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a" status: 200 len: 1513 microversion: 2.1 time: 0.282307 May 12 11:49:59.011774 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 328/661] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:58 2022] GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a => generated 1513 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:49:59.451245 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a441fe74-94ec-4f78-99cb-9ceb533e90bf tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:59.452636 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-a441fe74-94ec-4f78-99cb-9ceb533e90bf tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: f609a10d-385a-4eb7-92b3-cfd766e53d22] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:49:59.463342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a441fe74-94ec-4f78-99cb-9ceb533e90bf tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:59.464580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a441fe74-94ec-4f78-99cb-9ceb533e90bf tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:59.467105 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a441fe74-94ec-4f78-99cb-9ceb533e90bf tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:59.469018 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a441fe74-94ec-4f78-99cb-9ceb533e90bf tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:59.494069 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-a441fe74-94ec-4f78-99cb-9ceb533e90bf tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] HTTP exception thrown: Instance f609a10d-385a-4eb7-92b3-cfd766e53d22 could not be found. May 12 11:49:59.497098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a441fe74-94ec-4f78-99cb-9ceb533e90bf tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Request method failure captured: May 12 11:49:59.497098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 HTTP/1.1 May 12 11:49:59.497098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:49:59.497098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:49:59.497098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:49:59.497098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:49:59.497098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:49:59.497098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:49:59.497098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:49:59.497098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:49:59.497098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPNGiEbPp1EKOPM8sNNzsWH98UxNn4UhORk8h08QbSY1P98NX0wWcAMF--kKN9Sfif9Yy8ydOqvtWecpYzdDjBj7nMFaod6Rdr76MtudieQbbdR4fJr20z_3SgdOIL7B907xiJQ5HNOYIzBktDwljSn0ORqCfq8kCZ8WTAtnO6fO0B4 May 12 11:49:59.497098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:49:59.497098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:49:59.497098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:49:59.497098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:49:59.497098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:49:59.497098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:49:59.497098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: dd154e9ddff14089b8fc96ba030e5669 May 12 11:49:59.497098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1383743525 May 12 11:49:59.497098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:49:59.497098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:49:59.498492 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd154e9ddff14089b8fc96ba030e5669"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd154e9ddff14089b8fc96ba030e5669"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd154e9ddff14089b8fc96ba030e5669"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd154e9ddff14089b8fc96ba030e5669", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:49:59.498492 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1383743525 May 12 11:49:59.498492 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: dd154e9ddff14089b8fc96ba030e5669 May 12 11:49:59.498492 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1383743525 May 12 11:49:59.498492 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-ServerRescueNegativeTestJSON-1383743525-project May 12 11:49:59.498492 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:49:59.498492 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:49:59.498492 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: af0e1282e6024c9c8f128a8d7b235733 May 12 11:49:59.498492 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1383743525-project May 12 11:49:59.498492 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:49:59.498492 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance f609a10d-385a-4eb7-92b3-cfd766e53d22 could not be found. May 12 11:49:59.498492 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': 'f609a10d-385a-4eb7-92b3-cfd766e53d22'} May 12 11:49:59.499293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:49:59.499293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:49:59.499293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:49:59.499293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:49:59.499293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:49:59.499293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:49:59.499293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:49:59.499293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:49:59.499293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:49:59.499293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:49:59.499293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f609a10d-385a-4eb7-92b3-cfd766e53d22 could not be found. May 12 11:49:59.499293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:49:59.499293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:49:59.499293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:49:59.499293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:49:59.499293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:49:59.499293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:49:59.499293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:49:59.499293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:49:59.499293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:49:59.500510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:49:59.500510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:49:59.500510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:49:59.500510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:49:59.500510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:49:59.500510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:49:59.500510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:49:59.500510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f609a10d-385a-4eb7-92b3-cfd766e53d22 could not be found. May 12 11:49:59.500510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:49:59.500510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:49:59.500510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:49:59.500510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:49:59.500510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:49:59.500510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:49:59.500510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:49:59.500510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:49:59.500510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f609a10d-385a-4eb7-92b3-cfd766e53d22 could not be found. May 12 11:49:59.500510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:49:59.505857 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a441fe74-94ec-4f78-99cb-9ceb533e90bf tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Returning 404 to user: Instance f609a10d-385a-4eb7-92b3-cfd766e53d22 could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:49:59.507084 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-a441fe74-94ec-4f78-99cb-9ceb533e90bf tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22" status: 404 len: 111 microversion: 2.1 time: 0.061165 May 12 11:49:59.508619 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 334/662] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:49:59 2022] GET /compute/v2.1/servers/f609a10d-385a-4eb7-92b3-cfd766e53d22 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:49:59.516923 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-035b9078-03e9-4f1e-8b5b-185ba3f5f195 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '.version_select at 0x7f29f1c8c0d0>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:49:59.557988 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-035b9078-03e9-4f1e-8b5b-185ba3f5f195 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105373298" status: 202 len: 0 microversion: 2.1 time: 0.039157 May 12 11:49:59.561520 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 329/663] 10.222.0.58 () {58 vars in 1220 bytes} [Thu May 12 11:49:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105373298 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:49:59.622578 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-67cb3c35-5622-4826-9b65-037d5be51405 req-032bde2d-8a1d-46c4-ba8c-e7df721559f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba6039b3-958e-46ef-83e3-a942c113b22a", "name": "network-vif-deleted", "tag": "5a435639-c474-4088-a6dd-c7e042256655"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:49:59.636916 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-67cb3c35-5622-4826-9b65-037d5be51405 req-032bde2d-8a1d-46c4-ba8c-e7df721559f0 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:49:59.639673 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-67cb3c35-5622-4826-9b65-037d5be51405 req-032bde2d-8a1d-46c4-ba8c-e7df721559f0 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:49:59.672072 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-67cb3c35-5622-4826-9b65-037d5be51405 req-032bde2d-8a1d-46c4-ba8c-e7df721559f0 service nova] Creating event network-vif-deleted:5a435639-c474-4088-a6dd-c7e042256655 for instance ba6039b3-958e-46ef-83e3-a942c113b22a on hv-cinder-80473 May 12 11:49:59.679701 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-67cb3c35-5622-4826-9b65-037d5be51405 req-032bde2d-8a1d-46c4-ba8c-e7df721559f0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065443 May 12 11:49:59.683289 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 335/664] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:50:00.025447 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-1da590cc-b25a-4719-bf21-948edd768c28 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:00.026034 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-1da590cc-b25a-4719-bf21-948edd768c28 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: ba6039b3-958e-46ef-83e3-a942c113b22a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:00.037649 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1da590cc-b25a-4719-bf21-948edd768c28 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:00.037649 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1da590cc-b25a-4719-bf21-948edd768c28 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:00.037649 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1da590cc-b25a-4719-bf21-948edd768c28 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:00.037649 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1da590cc-b25a-4719-bf21-948edd768c28 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:00.096061 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1da590cc-b25a-4719-bf21-948edd768c28 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:00.096758 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1da590cc-b25a-4719-bf21-948edd768c28 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:00.097204 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.objects.instance [None req-1da590cc-b25a-4719-bf21-948edd768c28 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lazy-loading 'fault' on Instance uuid ba6039b3-958e-46ef-83e3-a942c113b22a {{(pid=123507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:50:00.192207 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-1da590cc-b25a-4719-bf21-948edd768c28 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70abbcb3651945609f0e65237135f3e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a1abe690e43433daccff30391d4b260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:00.203804 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-1da590cc-b25a-4719-bf21-948edd768c28 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a" status: 200 len: 1308 microversion: 2.1 time: 0.182457 May 12 11:50:00.205013 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 330/665] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:00 2022] GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a => generated 1308 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:01.135018 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a28551a1-c815-4c5a-a60c-99fd507bc1aa tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Action: 'create', calling method: .version_select at 0x7f29f24dc1f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-73243958", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHENW19akPlFUn3d/oC9AcynGoR5OWk7XKVyCnGnP2c7lNArptNtUhevOTmpb6qSW9gMSvIca2cdocScuj3TsBgC2qeYlEubneyMrfJZ870c9N5jPk+k6xDrcY2H2ux8Dw=="}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:50:01.148476 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-a28551a1-c815-4c5a-a60c-99fd507bc1aa tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Getting quotas for project cde372d003ca4f5fbafa9d6a4bc52e3e. Resources: {'key_pairs'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:50:01.152231 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-a28551a1-c815-4c5a-a60c-99fd507bc1aa tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Getting quotas for user 7f6da611aff04192a59cd39f3b2d6cb6 and project cde372d003ca4f5fbafa9d6a4bc52e3e. Resources: {'key_pairs'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:50:01.174781 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-a28551a1-c815-4c5a-a60c-99fd507bc1aa tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.147612 May 12 11:50:01.175419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 336/666] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 12 11:50:01 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:50:01.221912 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-117cb5d8-cfcb-4219-ac0b-3114e5bb0495 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:01.223133 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-117cb5d8-cfcb-4219-ac0b-3114e5bb0495 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] [instance: ba6039b3-958e-46ef-83e3-a942c113b22a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:01.229579 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-117cb5d8-cfcb-4219-ac0b-3114e5bb0495 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:01.230074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-117cb5d8-cfcb-4219-ac0b-3114e5bb0495 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:01.231070 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-117cb5d8-cfcb-4219-ac0b-3114e5bb0495 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:01.231511 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-117cb5d8-cfcb-4219-ac0b-3114e5bb0495 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:01.248204 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-117cb5d8-cfcb-4219-ac0b-3114e5bb0495 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] HTTP exception thrown: Instance ba6039b3-958e-46ef-83e3-a942c113b22a could not be found. May 12 11:50:01.250290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-117cb5d8-cfcb-4219-ac0b-3114e5bb0495 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Request method failure captured: May 12 11:50:01.250290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a HTTP/1.1 May 12 11:50:01.250290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:50:01.250290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:50:01.250290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:50:01.250290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 0 May 12 11:50:01.250290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:50:01.250290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:50:01.250290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:50:01.250290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:50:01.250290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPPvcBhjWlgLJqIOp1s-LjtK_e-kc6pKGiVccON4-4N352FFVQjAKs8WHm89rNn1K3VAgIlE-pFfjGTchxme1jugTje0L3GwjVgXt9pNZVrks-kUgWaJ1ML4MqvvHSKbobu9mnNbrBkh1Xh_GLEmHX4kvNge98owQMWcaDk4Fk2neaI May 12 11:50:01.250290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:50:01.250290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:50:01.250290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:50:01.250290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:50:01.250290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:50:01.250290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:50:01.250290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: 7a1abe690e43433daccff30391d4b260 May 12 11:50:01.250290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1205523019 May 12 11:50:01.250290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:50:01.250290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:50:01.251571 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7a1abe690e43433daccff30391d4b260"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7a1abe690e43433daccff30391d4b260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7a1abe690e43433daccff30391d4b260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7a1abe690e43433daccff30391d4b260", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:50:01.251571 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-VolumesSnapshotTestJSON-1205523019 May 12 11:50:01.251571 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: 7a1abe690e43433daccff30391d4b260 May 12 11:50:01.251571 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1205523019 May 12 11:50:01.251571 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-VolumesSnapshotTestJSON-1205523019-project May 12 11:50:01.251571 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:50:01.251571 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:50:01.251571 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: 70abbcb3651945609f0e65237135f3e7 May 12 11:50:01.251571 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-VolumesSnapshotTestJSON-1205523019-project May 12 11:50:01.251571 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: > May 12 11:50:01.251571 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Instance ba6039b3-958e-46ef-83e3-a942c113b22a could not be found. May 12 11:50:01.251571 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'id': 'ba6039b3-958e-46ef-83e3-a942c113b22a'} May 12 11:50:01.252287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:50:01.252287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:50:01.252287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:50:01.252287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:50:01.252287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:50:01.252287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:50:01.252287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:50:01.252287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:50:01.252287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:50:01.252287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:50:01.252287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba6039b3-958e-46ef-83e3-a942c113b22a could not be found. May 12 11:50:01.252287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:50:01.252287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:50:01.252287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:50:01.252287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:50:01.252287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:50:01.252287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:50:01.252287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:50:01.252287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:50:01.252287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:50:01.253567 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:50:01.253567 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:50:01.253567 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:50:01.253567 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:50:01.253567 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:50:01.253567 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:50:01.253567 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:50:01.253567 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba6039b3-958e-46ef-83e3-a942c113b22a could not be found. May 12 11:50:01.253567 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:50:01.253567 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:50:01.253567 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:50:01.253567 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:50:01.253567 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:50:01.253567 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:50:01.253567 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:50:01.253567 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:50:01.253567 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba6039b3-958e-46ef-83e3-a942c113b22a could not be found. May 12 11:50:01.253567 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:50:01.257497 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-117cb5d8-cfcb-4219-ac0b-3114e5bb0495 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] Returning 404 to user: Instance ba6039b3-958e-46ef-83e3-a942c113b22a could not be found. {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:50:01.258606 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-117cb5d8-cfcb-4219-ac0b-3114e5bb0495 tempest-VolumesSnapshotTestJSON-1205523019 tempest-VolumesSnapshotTestJSON-1205523019-project] 10.222.0.58 "GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a" status: 404 len: 111 microversion: 2.1 time: 0.041101 May 12 11:50:01.259695 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 331/667] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:01 2022] GET /compute/v2.1/servers/ba6039b3-958e-46ef-83e3-a942c113b22a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:50:02.884961 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-25b647c4-7b7b-4e7b-8176-943fe2a5a2ac tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:02.898034 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-25b647c4-7b7b-4e7b-8176-943fe2a5a2ac tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:02.919685 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-25b647c4-7b7b-4e7b-8176-943fe2a5a2ac tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:02.920061 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-25b647c4-7b7b-4e7b-8176-943fe2a5a2ac tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:02.920862 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-25b647c4-7b7b-4e7b-8176-943fe2a5a2ac tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:02.921877 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-25b647c4-7b7b-4e7b-8176-943fe2a5a2ac tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:02.976959 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-25b647c4-7b7b-4e7b-8176-943fe2a5a2ac tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Going to try to terminate instance {{(pid=123508) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 11:50:03.081098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-25b647c4-7b7b-4e7b-8176-943fe2a5a2ac tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 204 len: 0 microversion: 2.1 time: 0.200069 May 12 11:50:03.082088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 337/668] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:50:02 2022] DELETE /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 11:50:03.094125 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-cabd3b0b-3d02-4b14-8bbd-0606537f8477 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:03.095819 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-cabd3b0b-3d02-4b14-8bbd-0606537f8477 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:03.103405 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cabd3b0b-3d02-4b14-8bbd-0606537f8477 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:03.104219 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cabd3b0b-3d02-4b14-8bbd-0606537f8477 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:03.105158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cabd3b0b-3d02-4b14-8bbd-0606537f8477 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:03.105804 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cabd3b0b-3d02-4b14-8bbd-0606537f8477 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:03.253854 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-cabd3b0b-3d02-4b14-8bbd-0606537f8477 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:03.262444 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-cabd3b0b-3d02-4b14-8bbd-0606537f8477 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1507 microversion: 2.1 time: 0.174894 May 12 11:50:03.263917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 332/669] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:03 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:04.280657 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-31c1a299-53f5-44a4-a982-fe1fb54ef09b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:04.281942 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-31c1a299-53f5-44a4-a982-fe1fb54ef09b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:04.288429 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-31c1a299-53f5-44a4-a982-fe1fb54ef09b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:04.288917 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-31c1a299-53f5-44a4-a982-fe1fb54ef09b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:04.289695 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-31c1a299-53f5-44a4-a982-fe1fb54ef09b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:04.290183 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-31c1a299-53f5-44a4-a982-fe1fb54ef09b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:04.422387 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-31c1a299-53f5-44a4-a982-fe1fb54ef09b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:04.429912 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-31c1a299-53f5-44a4-a982-fe1fb54ef09b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1507 microversion: 2.1 time: 0.153407 May 12 11:50:04.430607 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 338/670] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:04 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:05.447771 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-6d6404a2-9fb5-4536-bcd0-e59100c6a06e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:05.448386 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-6d6404a2-9fb5-4536-bcd0-e59100c6a06e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:05.455657 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6d6404a2-9fb5-4536-bcd0-e59100c6a06e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:05.456107 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6d6404a2-9fb5-4536-bcd0-e59100c6a06e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:05.456881 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6d6404a2-9fb5-4536-bcd0-e59100c6a06e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:05.457324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6d6404a2-9fb5-4536-bcd0-e59100c6a06e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:05.590262 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-6d6404a2-9fb5-4536-bcd0-e59100c6a06e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:05.597681 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-6d6404a2-9fb5-4536-bcd0-e59100c6a06e tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1507 microversion: 2.1 time: 0.154057 May 12 11:50:05.598260 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 333/671] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:05 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:06.614734 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a548a8c4-511a-4959-9a91-fa071490023b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:06.615337 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-a548a8c4-511a-4959-9a91-fa071490023b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:06.621683 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a548a8c4-511a-4959-9a91-fa071490023b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:06.622155 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a548a8c4-511a-4959-9a91-fa071490023b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:06.622914 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a548a8c4-511a-4959-9a91-fa071490023b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:06.623663 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a548a8c4-511a-4959-9a91-fa071490023b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:06.752250 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-a548a8c4-511a-4959-9a91-fa071490023b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:06.759790 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-a548a8c4-511a-4959-9a91-fa071490023b tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1507 microversion: 2.1 time: 0.148710 May 12 11:50:06.760298 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 339/672] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:06 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:07.777323 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-2da7fd55-af04-475b-9d41-db56a20be7a8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:07.777939 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-2da7fd55-af04-475b-9d41-db56a20be7a8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:07.784524 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2da7fd55-af04-475b-9d41-db56a20be7a8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:07.785011 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2da7fd55-af04-475b-9d41-db56a20be7a8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:07.785810 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2da7fd55-af04-475b-9d41-db56a20be7a8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:07.786347 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2da7fd55-af04-475b-9d41-db56a20be7a8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:07.916112 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-2da7fd55-af04-475b-9d41-db56a20be7a8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:07.923359 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-2da7fd55-af04-475b-9d41-db56a20be7a8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1507 microversion: 2.1 time: 0.149834 May 12 11:50:07.923925 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 334/673] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:07 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:08.940859 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-c819a0f2-810c-4b0c-b4b1-ecf29f863e92 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:08.941559 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-c819a0f2-810c-4b0c-b4b1-ecf29f863e92 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:08.948102 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c819a0f2-810c-4b0c-b4b1-ecf29f863e92 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:08.948707 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c819a0f2-810c-4b0c-b4b1-ecf29f863e92 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:08.949526 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c819a0f2-810c-4b0c-b4b1-ecf29f863e92 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:08.949999 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c819a0f2-810c-4b0c-b4b1-ecf29f863e92 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:09.145457 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c819a0f2-810c-4b0c-b4b1-ecf29f863e92 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:09.152702 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-c819a0f2-810c-4b0c-b4b1-ecf29f863e92 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 200 len: 1507 microversion: 2.1 time: 0.217249 May 12 11:50:09.153270 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 340/674] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:08 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 1507 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:09.267322 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-cc4cb45f-e471-4ca2-a64a-5e82e5874330 req-1ea5253a-0da1-4495-8f65-44eda3ae505d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be16749-99b5-4f22-b115-cccceb984ce2", "name": "network-vif-deleted", "tag": "d8954dff-d153-4c3d-ad72-4aa8eef966c2"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:50:09.277229 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-cc4cb45f-e471-4ca2-a64a-5e82e5874330 req-1ea5253a-0da1-4495-8f65-44eda3ae505d service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:09.277883 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-cc4cb45f-e471-4ca2-a64a-5e82e5874330 req-1ea5253a-0da1-4495-8f65-44eda3ae505d service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:09.295211 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-cc4cb45f-e471-4ca2-a64a-5e82e5874330 req-1ea5253a-0da1-4495-8f65-44eda3ae505d service nova] Creating event network-vif-deleted:d8954dff-d153-4c3d-ad72-4aa8eef966c2 for instance 5be16749-99b5-4f22-b115-cccceb984ce2 on hv-cinder-80473 May 12 11:50:09.301477 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-cc4cb45f-e471-4ca2-a64a-5e82e5874330 req-1ea5253a-0da1-4495-8f65-44eda3ae505d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037998 May 12 11:50:09.304373 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 335/675] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:50:10.170100 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ddd65ba3-cf53-48de-9ad7-c7a99a604d2c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:10.170637 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-ddd65ba3-cf53-48de-9ad7-c7a99a604d2c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 5be16749-99b5-4f22-b115-cccceb984ce2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:10.176874 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ddd65ba3-cf53-48de-9ad7-c7a99a604d2c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:10.177342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ddd65ba3-cf53-48de-9ad7-c7a99a604d2c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:10.178123 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ddd65ba3-cf53-48de-9ad7-c7a99a604d2c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:10.178555 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ddd65ba3-cf53-48de-9ad7-c7a99a604d2c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:10.192279 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-ddd65ba3-cf53-48de-9ad7-c7a99a604d2c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] HTTP exception thrown: Instance 5be16749-99b5-4f22-b115-cccceb984ce2 could not be found. May 12 11:50:10.193952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ddd65ba3-cf53-48de-9ad7-c7a99a604d2c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Request method failure captured: May 12 11:50:10.193952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 HTTP/1.1 May 12 11:50:10.193952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:50:10.193952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:50:10.193952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:50:10.193952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:50:10.193952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:50:10.193952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:50:10.193952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:50:10.193952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:50:10.193952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPNGiEbPp1EKOPM8sNNzsWH98UxNn4UhORk8h08QbSY1P98NX0wWcAMF--kKN9Sfif9Yy8ydOqvtWecpYzdDjBj7nMFaod6Rdr76MtudieQbbdR4fJr20z_3SgdOIL7B907xiJQ5HNOYIzBktDwljSn0ORqCfq8kCZ8WTAtnO6fO0B4 May 12 11:50:10.193952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:50:10.193952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:50:10.193952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:50:10.193952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:50:10.193952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:50:10.193952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:50:10.193952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: dd154e9ddff14089b8fc96ba030e5669 May 12 11:50:10.193952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1383743525 May 12 11:50:10.193952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:50:10.193952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:50:10.195491 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd154e9ddff14089b8fc96ba030e5669"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd154e9ddff14089b8fc96ba030e5669"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd154e9ddff14089b8fc96ba030e5669"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd154e9ddff14089b8fc96ba030e5669", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:50:10.195491 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1383743525 May 12 11:50:10.195491 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: dd154e9ddff14089b8fc96ba030e5669 May 12 11:50:10.195491 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1383743525 May 12 11:50:10.195491 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-ServerRescueNegativeTestJSON-1383743525-project May 12 11:50:10.195491 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:50:10.195491 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:50:10.195491 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: af0e1282e6024c9c8f128a8d7b235733 May 12 11:50:10.195491 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1383743525-project May 12 11:50:10.195491 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:50:10.195491 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance 5be16749-99b5-4f22-b115-cccceb984ce2 could not be found. May 12 11:50:10.195491 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': '5be16749-99b5-4f22-b115-cccceb984ce2'} May 12 11:50:10.196363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:50:10.196363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:50:10.196363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:50:10.196363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:50:10.196363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:50:10.196363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:50:10.196363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:50:10.196363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:50:10.196363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:50:10.196363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:50:10.196363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5be16749-99b5-4f22-b115-cccceb984ce2 could not be found. May 12 11:50:10.196363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:50:10.196363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:50:10.196363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:50:10.196363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:50:10.196363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:50:10.196363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:50:10.196363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:50:10.196363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:50:10.196363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:50:10.198048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:50:10.198048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:50:10.198048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:50:10.198048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:50:10.198048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:50:10.198048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:50:10.198048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:50:10.198048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5be16749-99b5-4f22-b115-cccceb984ce2 could not be found. May 12 11:50:10.198048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:50:10.198048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:50:10.198048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:50:10.198048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:50:10.198048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:50:10.198048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:50:10.198048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:50:10.198048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:50:10.198048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5be16749-99b5-4f22-b115-cccceb984ce2 could not be found. May 12 11:50:10.198048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:50:10.199510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ddd65ba3-cf53-48de-9ad7-c7a99a604d2c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Returning 404 to user: Instance 5be16749-99b5-4f22-b115-cccceb984ce2 could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:50:10.199510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-ddd65ba3-cf53-48de-9ad7-c7a99a604d2c tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2" status: 404 len: 111 microversion: 2.1 time: 0.029240 May 12 11:50:10.199510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 341/676] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:10 2022] GET /compute/v2.1/servers/5be16749-99b5-4f22-b115-cccceb984ce2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 11:50:10.205556 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-196d5ebe-d751-4706-9962-621a6504af73 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:10.206202 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-196d5ebe-d751-4706-9962-621a6504af73 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:10.212168 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-196d5ebe-d751-4706-9962-621a6504af73 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:10.212610 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-196d5ebe-d751-4706-9962-621a6504af73 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:10.213362 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-196d5ebe-d751-4706-9962-621a6504af73 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:10.213821 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-196d5ebe-d751-4706-9962-621a6504af73 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:10.238611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-196d5ebe-d751-4706-9962-621a6504af73 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Going to try to terminate instance {{(pid=123507) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 11:50:10.312138 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-196d5ebe-d751-4706-9962-621a6504af73 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "DELETE /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 204 len: 0 microversion: 2.1 time: 0.111433 May 12 11:50:10.315785 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 336/677] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:50:10 2022] DELETE /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 11:50:10.320803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-d9df3f8e-e26f-4131-9b0b-19e13be4fc63 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:10.321420 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d9df3f8e-e26f-4131-9b0b-19e13be4fc63 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:10.327737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d9df3f8e-e26f-4131-9b0b-19e13be4fc63 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:10.328195 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d9df3f8e-e26f-4131-9b0b-19e13be4fc63 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:10.329491 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d9df3f8e-e26f-4131-9b0b-19e13be4fc63 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:10.329954 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d9df3f8e-e26f-4131-9b0b-19e13be4fc63 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:10.466321 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-d9df3f8e-e26f-4131-9b0b-19e13be4fc63 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:10.474336 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-d9df3f8e-e26f-4131-9b0b-19e13be4fc63 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.157350 May 12 11:50:10.474903 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 342/678] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:10 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:50:11.596739 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-13613b0e-71a5-41a2-95f7-368d55961c92 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:11.597462 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-13613b0e-71a5-41a2-95f7-368d55961c92 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:11.604497 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-13613b0e-71a5-41a2-95f7-368d55961c92 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:11.604950 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-13613b0e-71a5-41a2-95f7-368d55961c92 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:11.605742 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-13613b0e-71a5-41a2-95f7-368d55961c92 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:11.606188 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-13613b0e-71a5-41a2-95f7-368d55961c92 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:11.740600 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-13613b0e-71a5-41a2-95f7-368d55961c92 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:11.748233 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-13613b0e-71a5-41a2-95f7-368d55961c92 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.260264 May 12 11:50:11.748731 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 337/679] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:11 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:12.765063 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-abfcddeb-e3c3-4ae0-93df-1ca81bf7f8b8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:12.765617 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-abfcddeb-e3c3-4ae0-93df-1ca81bf7f8b8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:12.772585 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-abfcddeb-e3c3-4ae0-93df-1ca81bf7f8b8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:12.773046 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-abfcddeb-e3c3-4ae0-93df-1ca81bf7f8b8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:12.773905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-abfcddeb-e3c3-4ae0-93df-1ca81bf7f8b8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:12.774344 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-abfcddeb-e3c3-4ae0-93df-1ca81bf7f8b8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:12.904161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-abfcddeb-e3c3-4ae0-93df-1ca81bf7f8b8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:12.911538 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-abfcddeb-e3c3-4ae0-93df-1ca81bf7f8b8 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.150450 May 12 11:50:12.912103 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 343/680] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:12 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:13.929755 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-244cf3b0-a991-4286-986a-2603813efa6d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:13.930387 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-244cf3b0-a991-4286-986a-2603813efa6d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:13.937222 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-244cf3b0-a991-4286-986a-2603813efa6d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:13.937669 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-244cf3b0-a991-4286-986a-2603813efa6d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:13.938465 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-244cf3b0-a991-4286-986a-2603813efa6d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:13.938894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-244cf3b0-a991-4286-986a-2603813efa6d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:14.069877 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-244cf3b0-a991-4286-986a-2603813efa6d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:14.076997 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-244cf3b0-a991-4286-986a-2603813efa6d tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.151805 May 12 11:50:14.077597 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 338/681] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:13 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:15.094329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-476dc319-28fd-4e90-ba33-9ba177540658 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:15.095088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-476dc319-28fd-4e90-ba33-9ba177540658 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:15.101398 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-476dc319-28fd-4e90-ba33-9ba177540658 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:15.102140 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-476dc319-28fd-4e90-ba33-9ba177540658 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:15.103054 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-476dc319-28fd-4e90-ba33-9ba177540658 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:15.103595 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-476dc319-28fd-4e90-ba33-9ba177540658 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:15.309336 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-476dc319-28fd-4e90-ba33-9ba177540658 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e1282e6024c9c8f128a8d7b235733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd154e9ddff14089b8fc96ba030e5669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:15.317418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-476dc319-28fd-4e90-ba33-9ba177540658 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 200 len: 1520 microversion: 2.1 time: 0.226880 May 12 11:50:15.318118 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 344/682] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:15 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:15.528959 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 11:50:15.529445 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Thu May 12 11:50:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 11:50:15.543255 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-ae69bcab-1831-4349-9030-cb6cdcfabfa5 req-6b053b5f-7b78-4b75-90c3-bf1a665f34cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337fca44-29a2-43fd-bc5f-092ad95c83f8", "name": "network-vif-deleted", "tag": "17fde922-0d37-4159-bb44-fb31f42dc415"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:50:15.553350 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-ae69bcab-1831-4349-9030-cb6cdcfabfa5 req-6b053b5f-7b78-4b75-90c3-bf1a665f34cb service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:15.553814 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-ae69bcab-1831-4349-9030-cb6cdcfabfa5 req-6b053b5f-7b78-4b75-90c3-bf1a665f34cb service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:15.563964 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-ae69bcab-1831-4349-9030-cb6cdcfabfa5 req-6b053b5f-7b78-4b75-90c3-bf1a665f34cb service nova] Creating event network-vif-deleted:17fde922-0d37-4159-bb44-fb31f42dc415 for instance 337fca44-29a2-43fd-bc5f-092ad95c83f8 on hv-cinder-80473 May 12 11:50:15.569407 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-ae69bcab-1831-4349-9030-cb6cdcfabfa5 req-6b053b5f-7b78-4b75-90c3-bf1a665f34cb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029701 May 12 11:50:15.570018 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 339/683] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:50:16.334886 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a7c0f54a-4b55-40c0-ad1a-3109712e9603 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:16.335493 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-a7c0f54a-4b55-40c0-ad1a-3109712e9603 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] [instance: 337fca44-29a2-43fd-bc5f-092ad95c83f8] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:16.341778 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a7c0f54a-4b55-40c0-ad1a-3109712e9603 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:16.342233 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a7c0f54a-4b55-40c0-ad1a-3109712e9603 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:16.342994 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a7c0f54a-4b55-40c0-ad1a-3109712e9603 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:16.343433 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a7c0f54a-4b55-40c0-ad1a-3109712e9603 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:16.356790 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-a7c0f54a-4b55-40c0-ad1a-3109712e9603 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] HTTP exception thrown: Instance 337fca44-29a2-43fd-bc5f-092ad95c83f8 could not be found. May 12 11:50:16.358305 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a7c0f54a-4b55-40c0-ad1a-3109712e9603 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Request method failure captured: May 12 11:50:16.358305 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 HTTP/1.1 May 12 11:50:16.358305 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:50:16.358305 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:50:16.358305 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:50:16.358305 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:50:16.358305 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:50:16.358305 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:50:16.358305 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:50:16.358305 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:50:16.358305 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPNGiEbPp1EKOPM8sNNzsWH98UxNn4UhORk8h08QbSY1P98NX0wWcAMF--kKN9Sfif9Yy8ydOqvtWecpYzdDjBj7nMFaod6Rdr76MtudieQbbdR4fJr20z_3SgdOIL7B907xiJQ5HNOYIzBktDwljSn0ORqCfq8kCZ8WTAtnO6fO0B4 May 12 11:50:16.358305 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:50:16.358305 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:50:16.358305 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:50:16.358305 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:50:16.358305 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:50:16.358305 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:50:16.358305 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: dd154e9ddff14089b8fc96ba030e5669 May 12 11:50:16.358305 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1383743525 May 12 11:50:16.358305 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:50:16.358305 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:50:16.359782 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd154e9ddff14089b8fc96ba030e5669"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/dd154e9ddff14089b8fc96ba030e5669"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/dd154e9ddff14089b8fc96ba030e5669"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_dd154e9ddff14089b8fc96ba030e5669", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:50:16.359782 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1383743525 May 12 11:50:16.359782 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: dd154e9ddff14089b8fc96ba030e5669 May 12 11:50:16.359782 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1383743525 May 12 11:50:16.359782 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-ServerRescueNegativeTestJSON-1383743525-project May 12 11:50:16.359782 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:50:16.359782 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:50:16.359782 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: af0e1282e6024c9c8f128a8d7b235733 May 12 11:50:16.359782 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1383743525-project May 12 11:50:16.359782 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:50:16.359782 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance 337fca44-29a2-43fd-bc5f-092ad95c83f8 could not be found. May 12 11:50:16.359782 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': '337fca44-29a2-43fd-bc5f-092ad95c83f8'} May 12 11:50:16.360645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:50:16.360645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:50:16.360645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:50:16.360645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:50:16.360645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:50:16.360645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:50:16.360645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:50:16.360645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:50:16.360645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:50:16.360645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:50:16.360645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337fca44-29a2-43fd-bc5f-092ad95c83f8 could not be found. May 12 11:50:16.360645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:50:16.360645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:50:16.360645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:50:16.360645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:50:16.360645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:50:16.360645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:50:16.360645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:50:16.360645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:50:16.360645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:50:16.362115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:50:16.362115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:50:16.362115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:50:16.362115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:50:16.362115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:50:16.362115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:50:16.362115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:50:16.362115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337fca44-29a2-43fd-bc5f-092ad95c83f8 could not be found. May 12 11:50:16.362115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:50:16.362115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:50:16.362115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:50:16.362115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:50:16.362115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:50:16.362115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:50:16.362115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:50:16.362115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:50:16.362115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337fca44-29a2-43fd-bc5f-092ad95c83f8 could not be found. May 12 11:50:16.362115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:50:16.363424 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a7c0f54a-4b55-40c0-ad1a-3109712e9603 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] Returning 404 to user: Instance 337fca44-29a2-43fd-bc5f-092ad95c83f8 could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:50:16.363424 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-a7c0f54a-4b55-40c0-ad1a-3109712e9603 tempest-ServerRescueNegativeTestJSON-1383743525 tempest-ServerRescueNegativeTestJSON-1383743525-project] 10.222.0.58 "GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8" status: 404 len: 111 microversion: 2.1 time: 0.028617 May 12 11:50:16.363424 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 345/684] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:16 2022] GET /compute/v2.1/servers/337fca44-29a2-43fd-bc5f-092ad95c83f8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:50:20.490980 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-f5eaac92-4b1d-4995-aab1-9258da17015b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1699283959", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-73243958", "security_groups": [{"name": "tempest-secgroup-smoke-629760260"}], "networks": [{"uuid": "06d3be15-e26d-4a20-a86d-66f7e5ebcb6d"}], "block_device_mapping_v2": [{"uuid": "d00b162e-d83d-49b7-90e3-91655c9162a3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:50:20.599987 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.network.neutron [None req-f5eaac92-4b1d-4995-aab1-9258da17015b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] validate_networks() for [('06d3be15-e26d-4a20-a86d-66f7e5ebcb6d', None, None, None, None, None)] {{(pid=123507) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 11:50:21.079725 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-f5eaac92-4b1d-4995-aab1-9258da17015b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Flavor limits 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 11:50:21.081129 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-f5eaac92-4b1d-4995-aab1-9258da17015b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Image limits 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 11:50:21.081749 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-f5eaac92-4b1d-4995-aab1-9258da17015b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Flavor pref 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 11:50:21.082340 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-f5eaac92-4b1d-4995-aab1-9258da17015b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Image pref 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 11:50:21.082852 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-f5eaac92-4b1d-4995-aab1-9258da17015b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 11:50:21.092461 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f5eaac92-4b1d-4995-aab1-9258da17015b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:21.092985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f5eaac92-4b1d-4995-aab1-9258da17015b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:21.093960 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f5eaac92-4b1d-4995-aab1-9258da17015b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:21.094536 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f5eaac92-4b1d-4995-aab1-9258da17015b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:21.112727 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-f5eaac92-4b1d-4995-aab1-9258da17015b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Getting quotas for project cde372d003ca4f5fbafa9d6a4bc52e3e. Resources: {'ram', 'cores', 'instances'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:50:21.117062 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-f5eaac92-4b1d-4995-aab1-9258da17015b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Getting quotas for user 7f6da611aff04192a59cd39f3b2d6cb6 and project cde372d003ca4f5fbafa9d6a4bc52e3e. Resources: {'ram', 'cores', 'instances'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:50:21.175453 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-f5eaac92-4b1d-4995-aab1-9258da17015b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Going to run 1 instances... {{(pid=123507) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 11:50:21.177625 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-f5eaac92-4b1d-4995-aab1-9258da17015b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d00b162e-d83d-49b7-90e3-91655c9162a3',volume_size=None,volume_type=None)] {{(pid=123507) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 11:50:21.308105 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-f5eaac92-4b1d-4995-aab1-9258da17015b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.822390 May 12 11:50:21.308898 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 340/685] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 12 11:50:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 11:50:21.319683 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-14880cab-e8c8-45ab-81a5-94a3981371f3 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:21.320307 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-14880cab-e8c8-45ab-81a5-94a3981371f3 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:21.382309 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-14880cab-e8c8-45ab-81a5-94a3981371f3 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:21.391587 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-14880cab-e8c8-45ab-81a5-94a3981371f3 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1087 microversion: 2.1 time: 0.076035 May 12 11:50:21.392163 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 346/686] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:21 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1087 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:50:22.411532 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-57c2b068-18ce-49e8-adad-c79c72d3fffa tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:22.412227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-57c2b068-18ce-49e8-adad-c79c72d3fffa tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:22.418907 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-57c2b068-18ce-49e8-adad-c79c72d3fffa tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:22.419350 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-57c2b068-18ce-49e8-adad-c79c72d3fffa tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:22.420139 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-57c2b068-18ce-49e8-adad-c79c72d3fffa tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:22.420572 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-57c2b068-18ce-49e8-adad-c79c72d3fffa tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:22.484498 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-57c2b068-18ce-49e8-adad-c79c72d3fffa tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:22.492217 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-57c2b068-18ce-49e8-adad-c79c72d3fffa tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1193 microversion: 2.1 time: 0.085498 May 12 11:50:22.492927 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 341/687] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:22 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:23.510032 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-377dea5a-4469-440c-bd22-bb0837f9d3f6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:23.511259 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-377dea5a-4469-440c-bd22-bb0837f9d3f6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:23.524376 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-377dea5a-4469-440c-bd22-bb0837f9d3f6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:23.524376 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-377dea5a-4469-440c-bd22-bb0837f9d3f6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:23.524376 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-377dea5a-4469-440c-bd22-bb0837f9d3f6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:23.524376 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-377dea5a-4469-440c-bd22-bb0837f9d3f6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:23.743083 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-377dea5a-4469-440c-bd22-bb0837f9d3f6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:23.750727 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-377dea5a-4469-440c-bd22-bb0837f9d3f6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1258 microversion: 2.1 time: 0.244719 May 12 11:50:23.751302 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 347/688] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:23 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1258 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:24.292120 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-cd5c4163-3747-4823-81c9-66297278cd18 req-564b4c38-681b-463c-a960-9732b67c3049 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d747a75-e74d-4c41-9707-aee578ce2d01", "tag": "0b817862-786a-4db4-bdba-c4efd02f2cda"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:50:24.302014 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-cd5c4163-3747-4823-81c9-66297278cd18 req-564b4c38-681b-463c-a960-9732b67c3049 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:24.302409 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-cd5c4163-3747-4823-81c9-66297278cd18 req-564b4c38-681b-463c-a960-9732b67c3049 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:24.314914 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-cd5c4163-3747-4823-81c9-66297278cd18 req-564b4c38-681b-463c-a960-9732b67c3049 service nova] Creating event network-changed:0b817862-786a-4db4-bdba-c4efd02f2cda for instance 8d747a75-e74d-4c41-9707-aee578ce2d01 on hv-cinder-80473 May 12 11:50:24.320334 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-cd5c4163-3747-4823-81c9-66297278cd18 req-564b4c38-681b-463c-a960-9732b67c3049 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.225198 May 12 11:50:24.320982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 342/689] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:50:24.769771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-3b138a3f-b99e-4587-afbe-38b6b76e5aaa tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:24.770402 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-3b138a3f-b99e-4587-afbe-38b6b76e5aaa tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:24.777082 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3b138a3f-b99e-4587-afbe-38b6b76e5aaa tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:24.777566 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3b138a3f-b99e-4587-afbe-38b6b76e5aaa tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:24.778378 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3b138a3f-b99e-4587-afbe-38b6b76e5aaa tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:24.778873 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3b138a3f-b99e-4587-afbe-38b6b76e5aaa tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:24.990199 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-3b138a3f-b99e-4587-afbe-38b6b76e5aaa tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:24.997322 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-3b138a3f-b99e-4587-afbe-38b6b76e5aaa tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1258 microversion: 2.1 time: 0.232691 May 12 11:50:24.998111 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 348/690] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:24 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1258 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:26.015620 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-fc7243dd-9f5f-4f44-b524-75126ebeb4d3 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:26.016488 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-fc7243dd-9f5f-4f44-b524-75126ebeb4d3 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:26.022866 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fc7243dd-9f5f-4f44-b524-75126ebeb4d3 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:26.023304 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fc7243dd-9f5f-4f44-b524-75126ebeb4d3 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:26.024066 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fc7243dd-9f5f-4f44-b524-75126ebeb4d3 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:26.024494 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fc7243dd-9f5f-4f44-b524-75126ebeb4d3 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:26.155284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-fc7243dd-9f5f-4f44-b524-75126ebeb4d3 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:26.162485 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-fc7243dd-9f5f-4f44-b524-75126ebeb4d3 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1258 microversion: 2.1 time: 0.151304 May 12 11:50:26.163044 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 343/691] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:26 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:27.178334 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-83e9970b-9ebf-449b-87ed-e5a3b43ba084 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:27.178978 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-83e9970b-9ebf-449b-87ed-e5a3b43ba084 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:27.185264 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-83e9970b-9ebf-449b-87ed-e5a3b43ba084 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:27.185730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-83e9970b-9ebf-449b-87ed-e5a3b43ba084 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:27.186522 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-83e9970b-9ebf-449b-87ed-e5a3b43ba084 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:27.186964 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-83e9970b-9ebf-449b-87ed-e5a3b43ba084 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:27.353595 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-83e9970b-9ebf-449b-87ed-e5a3b43ba084 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:27.360868 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-83e9970b-9ebf-449b-87ed-e5a3b43ba084 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1258 microversion: 2.1 time: 0.186344 May 12 11:50:27.361441 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 349/692] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:27 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1258 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:28.378041 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-274ae0be-4d30-4c89-9bde-dd9cccf1ab8a tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:28.378714 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-274ae0be-4d30-4c89-9bde-dd9cccf1ab8a tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:28.384955 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-274ae0be-4d30-4c89-9bde-dd9cccf1ab8a tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:28.385407 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-274ae0be-4d30-4c89-9bde-dd9cccf1ab8a tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:28.386199 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-274ae0be-4d30-4c89-9bde-dd9cccf1ab8a tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:28.386641 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-274ae0be-4d30-4c89-9bde-dd9cccf1ab8a tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:28.514273 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-274ae0be-4d30-4c89-9bde-dd9cccf1ab8a tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:28.521987 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-274ae0be-4d30-4c89-9bde-dd9cccf1ab8a tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1258 microversion: 2.1 time: 0.147904 May 12 11:50:28.522547 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 344/693] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:28 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1258 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:28.814879 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-cbab2790-9bda-47f2-9306-4a63e1f6c8a5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:28.815401 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-cbab2790-9bda-47f2-9306-4a63e1f6c8a5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:28.821175 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cbab2790-9bda-47f2-9306-4a63e1f6c8a5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:28.821625 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cbab2790-9bda-47f2-9306-4a63e1f6c8a5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:28.822423 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cbab2790-9bda-47f2-9306-4a63e1f6c8a5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:28.822861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cbab2790-9bda-47f2-9306-4a63e1f6c8a5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:28.845606 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-cbab2790-9bda-47f2-9306-4a63e1f6c8a5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab/ips" status: 200 len: 151 microversion: 2.20 time: 0.243628 May 12 11:50:28.846165 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 350/694] 10.222.0.58 () {60 vars in 1288 bytes} [Thu May 12 11:50:28 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab/ips => generated 151 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 11:50:29.538944 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-7627a719-2bc1-405c-8484-8647afcf79fd tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:29.539555 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-7627a719-2bc1-405c-8484-8647afcf79fd tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:29.545941 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7627a719-2bc1-405c-8484-8647afcf79fd tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:29.546390 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7627a719-2bc1-405c-8484-8647afcf79fd tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:29.547158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7627a719-2bc1-405c-8484-8647afcf79fd tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:29.547657 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7627a719-2bc1-405c-8484-8647afcf79fd tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:29.687437 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-7627a719-2bc1-405c-8484-8647afcf79fd tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:29.694527 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-7627a719-2bc1-405c-8484-8647afcf79fd tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1258 microversion: 2.1 time: 0.159478 May 12 11:50:29.695327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 345/695] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:29 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:30.711990 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-d5fc45f6-872d-4f18-b9ac-60161e29dc79 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:30.712842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d5fc45f6-872d-4f18-b9ac-60161e29dc79 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:30.719946 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d5fc45f6-872d-4f18-b9ac-60161e29dc79 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:30.720483 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d5fc45f6-872d-4f18-b9ac-60161e29dc79 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:30.721264 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d5fc45f6-872d-4f18-b9ac-60161e29dc79 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:30.721728 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d5fc45f6-872d-4f18-b9ac-60161e29dc79 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:30.795461 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-3248d82a-e598-4d61-9873-22a0c0c97017 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:50:30.796048 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-3248d82a-e598-4d61-9873-22a0c0c97017 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:30.803378 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3248d82a-e598-4d61-9873-22a0c0c97017 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:30.803977 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3248d82a-e598-4d61-9873-22a0c0c97017 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:30.804882 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3248d82a-e598-4d61-9873-22a0c0c97017 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:30.805326 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3248d82a-e598-4d61-9873-22a0c0c97017 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:30.832843 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.objects.instance [None req-3248d82a-e598-4d61-9873-22a0c0c97017 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lazy-loading 'flavor' on Instance uuid efbc8e04-31bd-4238-8c9a-096ad87a46ab {{(pid=123507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:50:30.894815 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-d5fc45f6-872d-4f18-b9ac-60161e29dc79 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:30.902883 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-d5fc45f6-872d-4f18-b9ac-60161e29dc79 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1258 microversion: 2.1 time: 0.194929 May 12 11:50:30.903722 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 351/696] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:30 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1258 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:31.112898 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-3248d82a-e598-4d61-9873-22a0c0c97017 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "POST /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab/action" status: 202 len: 0 microversion: 2.20 time: 0.320997 May 12 11:50:31.116599 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 346/697] 10.222.0.58 () {62 vars in 1318 bytes} [Thu May 12 11:50:30 2022] POST /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 12 11:50:31.122964 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ec6eeadf-e0d5-4da0-b506-a0bc4abc8d41 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:31.123567 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-ec6eeadf-e0d5-4da0-b506-a0bc4abc8d41 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:31.131498 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ec6eeadf-e0d5-4da0-b506-a0bc4abc8d41 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:31.131949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ec6eeadf-e0d5-4da0-b506-a0bc4abc8d41 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:31.133162 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ec6eeadf-e0d5-4da0-b506-a0bc4abc8d41 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:31.133603 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ec6eeadf-e0d5-4da0-b506-a0bc4abc8d41 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:31.279132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-ec6eeadf-e0d5-4da0-b506-a0bc4abc8d41 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:31.284845 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-ec6eeadf-e0d5-4da0-b506-a0bc4abc8d41 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:31.285729 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-61376016-8839-4624-8afe-8d21876976c1 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:31.286909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-ec6eeadf-e0d5-4da0-b506-a0bc4abc8d41 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:31.287462 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-61376016-8839-4624-8afe-8d21876976c1 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:31.288574 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-ec6eeadf-e0d5-4da0-b506-a0bc4abc8d41 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1723 microversion: 2.20 time: 0.170164 May 12 11:50:31.289350 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 352/698] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:31 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:50:31.299687 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-61376016-8839-4624-8afe-8d21876976c1 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:31.300143 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-61376016-8839-4624-8afe-8d21876976c1 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:31.300929 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-61376016-8839-4624-8afe-8d21876976c1 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:31.301367 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-61376016-8839-4624-8afe-8d21876976c1 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:31.331169 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-61376016-8839-4624-8afe-8d21876976c1 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050860 May 12 11:50:31.331737 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 347/699] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 12 11:50:31 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 12 11:50:31.388983 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-98137d75-ef10-49bf-9313-e5f4da8b85b2 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:31.389489 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-98137d75-ef10-49bf-9313-e5f4da8b85b2 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:31.407506 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-98137d75-ef10-49bf-9313-e5f4da8b85b2 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:31.408533 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-98137d75-ef10-49bf-9313-e5f4da8b85b2 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:31.409325 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-98137d75-ef10-49bf-9313-e5f4da8b85b2 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:31.409860 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-98137d75-ef10-49bf-9313-e5f4da8b85b2 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:31.434674 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-98137d75-ef10-49bf-9313-e5f4da8b85b2 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Going to try to terminate instance {{(pid=123508) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 11:50:31.519143 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-98137d75-ef10-49bf-9313-e5f4da8b85b2 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 204 len: 0 microversion: 2.1 time: 0.133913 May 12 11:50:31.519774 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 353/700] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:50:31 2022] DELETE /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 11:50:31.528485 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-93fd1a25-dac2-48de-aaaf-d1f530a5248a tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:31.529223 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-93fd1a25-dac2-48de-aaaf-d1f530a5248a tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:31.539841 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-93fd1a25-dac2-48de-aaaf-d1f530a5248a tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:31.540291 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-93fd1a25-dac2-48de-aaaf-d1f530a5248a tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:31.541073 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-93fd1a25-dac2-48de-aaaf-d1f530a5248a tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:31.541510 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-93fd1a25-dac2-48de-aaaf-d1f530a5248a tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:31.683384 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-93fd1a25-dac2-48de-aaaf-d1f530a5248a tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:31.690778 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-93fd1a25-dac2-48de-aaaf-d1f530a5248a tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1672 microversion: 2.1 time: 0.166178 May 12 11:50:31.691459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 348/701] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:31 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:31.920838 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-addf2342-beff-4b43-8468-6a8b55e57626 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:31.921471 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-addf2342-beff-4b43-8468-6a8b55e57626 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:31.928512 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-addf2342-beff-4b43-8468-6a8b55e57626 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:31.928965 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-addf2342-beff-4b43-8468-6a8b55e57626 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:31.929753 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-addf2342-beff-4b43-8468-6a8b55e57626 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:31.930193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-addf2342-beff-4b43-8468-6a8b55e57626 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:32.068175 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-addf2342-beff-4b43-8468-6a8b55e57626 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:32.075439 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-addf2342-beff-4b43-8468-6a8b55e57626 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1258 microversion: 2.1 time: 0.158838 May 12 11:50:32.076018 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 354/702] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:31 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:32.307412 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-caf51218-553a-4208-bf0d-0c66c6d7b087 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:32.308097 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-caf51218-553a-4208-bf0d-0c66c6d7b087 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:32.315273 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-caf51218-553a-4208-bf0d-0c66c6d7b087 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:32.315806 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-caf51218-553a-4208-bf0d-0c66c6d7b087 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:32.316716 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-caf51218-553a-4208-bf0d-0c66c6d7b087 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:32.317233 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-caf51218-553a-4208-bf0d-0c66c6d7b087 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:32.446005 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-caf51218-553a-4208-bf0d-0c66c6d7b087 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:32.455484 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-caf51218-553a-4208-bf0d-0c66c6d7b087 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:32.457079 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-caf51218-553a-4208-bf0d-0c66c6d7b087 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:32.458268 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-caf51218-553a-4208-bf0d-0c66c6d7b087 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1723 microversion: 2.20 time: 0.154731 May 12 11:50:32.458824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 349/703] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:32 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:50:32.707561 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b2ddaa42-7ed1-4278-97ee-f7402f23cc67 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:32.708166 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-b2ddaa42-7ed1-4278-97ee-f7402f23cc67 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:32.714086 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b2ddaa42-7ed1-4278-97ee-f7402f23cc67 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:32.714542 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b2ddaa42-7ed1-4278-97ee-f7402f23cc67 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:32.715314 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b2ddaa42-7ed1-4278-97ee-f7402f23cc67 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:32.715911 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b2ddaa42-7ed1-4278-97ee-f7402f23cc67 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:32.851647 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b2ddaa42-7ed1-4278-97ee-f7402f23cc67 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:32.859177 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-b2ddaa42-7ed1-4278-97ee-f7402f23cc67 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1672 microversion: 2.1 time: 0.155722 May 12 11:50:32.860101 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 355/704] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:32 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:33.093018 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-63df632c-3dde-4ab9-b88f-0a7947fba79f tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:33.093862 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-63df632c-3dde-4ab9-b88f-0a7947fba79f tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:33.100428 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-63df632c-3dde-4ab9-b88f-0a7947fba79f tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:33.100875 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-63df632c-3dde-4ab9-b88f-0a7947fba79f tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:33.101964 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-63df632c-3dde-4ab9-b88f-0a7947fba79f tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:33.102401 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-63df632c-3dde-4ab9-b88f-0a7947fba79f tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:33.238364 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-63df632c-3dde-4ab9-b88f-0a7947fba79f tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:33.245574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-63df632c-3dde-4ab9-b88f-0a7947fba79f tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1258 microversion: 2.1 time: 0.156643 May 12 11:50:33.246174 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 350/705] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:33 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:33.476284 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-4f22e45f-b8b2-4dc4-aa7d-025f53225f79 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:33.476804 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-4f22e45f-b8b2-4dc4-aa7d-025f53225f79 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:33.483075 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4f22e45f-b8b2-4dc4-aa7d-025f53225f79 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:33.483529 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4f22e45f-b8b2-4dc4-aa7d-025f53225f79 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:33.484291 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4f22e45f-b8b2-4dc4-aa7d-025f53225f79 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:33.484732 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4f22e45f-b8b2-4dc4-aa7d-025f53225f79 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:33.614835 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-4f22e45f-b8b2-4dc4-aa7d-025f53225f79 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:33.622869 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-4f22e45f-b8b2-4dc4-aa7d-025f53225f79 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:33.624702 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-4f22e45f-b8b2-4dc4-aa7d-025f53225f79 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:33.625900 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-4f22e45f-b8b2-4dc4-aa7d-025f53225f79 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1723 microversion: 2.20 time: 0.153699 May 12 11:50:33.626473 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 356/706] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:33 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:50:33.876234 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-57b3b00a-f8b2-483b-9b78-b562cf1d2be3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:33.877383 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-57b3b00a-f8b2-483b-9b78-b562cf1d2be3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:33.883844 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-57b3b00a-f8b2-483b-9b78-b562cf1d2be3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:33.884295 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-57b3b00a-f8b2-483b-9b78-b562cf1d2be3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:33.885062 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-57b3b00a-f8b2-483b-9b78-b562cf1d2be3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:33.885499 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-57b3b00a-f8b2-483b-9b78-b562cf1d2be3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:34.006855 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-57b3b00a-f8b2-483b-9b78-b562cf1d2be3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:34.014440 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-57b3b00a-f8b2-483b-9b78-b562cf1d2be3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1672 microversion: 2.1 time: 0.142014 May 12 11:50:34.015019 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 351/707] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:33 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1672 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:34.263023 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-8511fefe-c78b-445c-9bd9-c2d135564936 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:34.263764 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-8511fefe-c78b-445c-9bd9-c2d135564936 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:34.271144 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8511fefe-c78b-445c-9bd9-c2d135564936 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:34.271731 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8511fefe-c78b-445c-9bd9-c2d135564936 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:34.272566 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8511fefe-c78b-445c-9bd9-c2d135564936 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:34.273056 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8511fefe-c78b-445c-9bd9-c2d135564936 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:34.551432 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8511fefe-c78b-445c-9bd9-c2d135564936 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:34.558891 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-8511fefe-c78b-445c-9bd9-c2d135564936 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1258 microversion: 2.1 time: 0.300014 May 12 11:50:34.559462 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 357/708] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:34 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1258 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:34.644978 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-41b08bc4-80e9-44ba-b901-72e5f70ef2b9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:34.645583 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-41b08bc4-80e9-44ba-b901-72e5f70ef2b9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:34.651364 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-41b08bc4-80e9-44ba-b901-72e5f70ef2b9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:34.651804 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-41b08bc4-80e9-44ba-b901-72e5f70ef2b9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:34.652560 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-41b08bc4-80e9-44ba-b901-72e5f70ef2b9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:34.653010 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-41b08bc4-80e9-44ba-b901-72e5f70ef2b9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:34.784411 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-41b08bc4-80e9-44ba-b901-72e5f70ef2b9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:34.792682 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-41b08bc4-80e9-44ba-b901-72e5f70ef2b9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:34.794219 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-41b08bc4-80e9-44ba-b901-72e5f70ef2b9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:34.795400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-41b08bc4-80e9-44ba-b901-72e5f70ef2b9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1723 microversion: 2.20 time: 0.155039 May 12 11:50:34.795967 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 352/709] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:34 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:50:35.031300 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ab400af4-be91-4e37-a71a-b49d7d27b1c0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:35.032059 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-ab400af4-be91-4e37-a71a-b49d7d27b1c0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:35.038821 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ab400af4-be91-4e37-a71a-b49d7d27b1c0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:35.038821 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ab400af4-be91-4e37-a71a-b49d7d27b1c0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:35.040054 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ab400af4-be91-4e37-a71a-b49d7d27b1c0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:35.040054 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ab400af4-be91-4e37-a71a-b49d7d27b1c0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:35.116250 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-ab400af4-be91-4e37-a71a-b49d7d27b1c0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:35.123479 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-ab400af4-be91-4e37-a71a-b49d7d27b1c0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1604 microversion: 2.1 time: 0.096045 May 12 11:50:35.124369 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 358/710] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:35 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1604 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:35.349315 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-44a469cd-2411-43d3-88bf-d3d5ae529be0 req-7c064031-f125-46c1-9a77-b80fcc4e85ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf4fa9e-950e-4be3-b042-517c2079c0f2", "name": "network-vif-deleted", "tag": "2fe78454-40e0-452b-9fda-bc63a3a68799"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:50:35.358357 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-44a469cd-2411-43d3-88bf-d3d5ae529be0 req-7c064031-f125-46c1-9a77-b80fcc4e85ca service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:35.358822 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-44a469cd-2411-43d3-88bf-d3d5ae529be0 req-7c064031-f125-46c1-9a77-b80fcc4e85ca service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:35.372057 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-44a469cd-2411-43d3-88bf-d3d5ae529be0 req-7c064031-f125-46c1-9a77-b80fcc4e85ca service nova] Creating event network-vif-deleted:2fe78454-40e0-452b-9fda-bc63a3a68799 for instance 6bf4fa9e-950e-4be3-b042-517c2079c0f2 on hv-cinder-80473 May 12 11:50:35.378010 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-44a469cd-2411-43d3-88bf-d3d5ae529be0 req-7c064031-f125-46c1-9a77-b80fcc4e85ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031512 May 12 11:50:35.389263 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 353/711] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:50:35.575717 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-dd0f45f0-e9ab-4276-beba-63af081e8a15 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:35.576241 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-dd0f45f0-e9ab-4276-beba-63af081e8a15 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:35.582748 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dd0f45f0-e9ab-4276-beba-63af081e8a15 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:35.583194 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dd0f45f0-e9ab-4276-beba-63af081e8a15 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:35.584589 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dd0f45f0-e9ab-4276-beba-63af081e8a15 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:35.585041 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dd0f45f0-e9ab-4276-beba-63af081e8a15 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:35.717099 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-dd0f45f0-e9ab-4276-beba-63af081e8a15 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:35.724491 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-dd0f45f0-e9ab-4276-beba-63af081e8a15 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1258 microversion: 2.1 time: 0.152863 May 12 11:50:35.725258 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 359/712] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:35 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:35.815022 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-06e06b42-cea5-4de4-a40e-08509dba7eea tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:35.815710 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-06e06b42-cea5-4de4-a40e-08509dba7eea tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:35.821744 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-06e06b42-cea5-4de4-a40e-08509dba7eea tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:35.822192 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-06e06b42-cea5-4de4-a40e-08509dba7eea tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:35.822948 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-06e06b42-cea5-4de4-a40e-08509dba7eea tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:35.823407 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-06e06b42-cea5-4de4-a40e-08509dba7eea tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:35.953568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-06e06b42-cea5-4de4-a40e-08509dba7eea tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:35.962073 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-06e06b42-cea5-4de4-a40e-08509dba7eea tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:35.963559 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-06e06b42-cea5-4de4-a40e-08509dba7eea tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:35.964701 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-06e06b42-cea5-4de4-a40e-08509dba7eea tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1723 microversion: 2.20 time: 0.154959 May 12 11:50:35.965255 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 354/713] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:35 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:50:36.140359 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-24df0afb-1204-4981-af3f-3577c79496c9 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:36.140970 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-24df0afb-1204-4981-af3f-3577c79496c9 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:36.147472 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-24df0afb-1204-4981-af3f-3577c79496c9 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:36.148130 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-24df0afb-1204-4981-af3f-3577c79496c9 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:36.149101 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-24df0afb-1204-4981-af3f-3577c79496c9 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:36.149694 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-24df0afb-1204-4981-af3f-3577c79496c9 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:36.211843 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-24df0afb-1204-4981-af3f-3577c79496c9 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:36.219328 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-24df0afb-1204-4981-af3f-3577c79496c9 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1604 microversion: 2.1 time: 0.082779 May 12 11:50:36.219904 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 360/714] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:36 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1604 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:36.741739 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-92f02ad7-6465-4f92-913b-8b42619db9b4 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:36.742355 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-92f02ad7-6465-4f92-913b-8b42619db9b4 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:36.748485 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-92f02ad7-6465-4f92-913b-8b42619db9b4 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:36.748924 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-92f02ad7-6465-4f92-913b-8b42619db9b4 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:36.749677 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-92f02ad7-6465-4f92-913b-8b42619db9b4 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:36.750138 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-92f02ad7-6465-4f92-913b-8b42619db9b4 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:36.880110 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-92f02ad7-6465-4f92-913b-8b42619db9b4 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:36.887454 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-92f02ad7-6465-4f92-913b-8b42619db9b4 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1258 microversion: 2.1 time: 0.149619 May 12 11:50:36.888026 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 355/715] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:36 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:36.982201 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-04837c3e-198f-4a8f-ba20-f863959a707b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:36.982809 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-04837c3e-198f-4a8f-ba20-f863959a707b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:36.989166 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-04837c3e-198f-4a8f-ba20-f863959a707b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:36.989614 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-04837c3e-198f-4a8f-ba20-f863959a707b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:36.990428 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-04837c3e-198f-4a8f-ba20-f863959a707b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:36.990865 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-04837c3e-198f-4a8f-ba20-f863959a707b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:37.122342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-04837c3e-198f-4a8f-ba20-f863959a707b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:37.130292 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-04837c3e-198f-4a8f-ba20-f863959a707b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:37.131781 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-04837c3e-198f-4a8f-ba20-f863959a707b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:37.132934 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-04837c3e-198f-4a8f-ba20-f863959a707b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1723 microversion: 2.20 time: 0.154626 May 12 11:50:37.133500 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 361/716] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:36 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:50:37.236436 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-678c8ce5-99f2-435b-a4d3-ae997643b503 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:37.236956 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-678c8ce5-99f2-435b-a4d3-ae997643b503 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:37.243079 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-678c8ce5-99f2-435b-a4d3-ae997643b503 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:37.243626 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-678c8ce5-99f2-435b-a4d3-ae997643b503 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:37.244641 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-678c8ce5-99f2-435b-a4d3-ae997643b503 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:37.245163 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-678c8ce5-99f2-435b-a4d3-ae997643b503 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:37.275717 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-678c8ce5-99f2-435b-a4d3-ae997643b503 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:37.276166 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-678c8ce5-99f2-435b-a4d3-ae997643b503 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:37.276612 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.objects.instance [None req-678c8ce5-99f2-435b-a4d3-ae997643b503 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lazy-loading 'fault' on Instance uuid 6bf4fa9e-950e-4be3-b042-517c2079c0f2 {{(pid=123507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:50:37.319820 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-678c8ce5-99f2-435b-a4d3-ae997643b503 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:37.327286 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-678c8ce5-99f2-435b-a4d3-ae997643b503 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 200 len: 1326 microversion: 2.1 time: 0.094841 May 12 11:50:37.327861 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 356/717] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:37 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 1326 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:37.903939 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-da625fc8-0925-48aa-93b3-700ba1b8d233 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:37.904584 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-da625fc8-0925-48aa-93b3-700ba1b8d233 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:37.910440 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-da625fc8-0925-48aa-93b3-700ba1b8d233 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:37.910891 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-da625fc8-0925-48aa-93b3-700ba1b8d233 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:37.911660 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-da625fc8-0925-48aa-93b3-700ba1b8d233 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:37.912101 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-da625fc8-0925-48aa-93b3-700ba1b8d233 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:38.039662 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-da625fc8-0925-48aa-93b3-700ba1b8d233 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:38.046919 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-da625fc8-0925-48aa-93b3-700ba1b8d233 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1258 microversion: 2.1 time: 0.146814 May 12 11:50:38.047487 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 362/718] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:37 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1258 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:38.150721 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-37c2a967-7a4f-4189-b4a7-4f8019e131fb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:38.151278 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-37c2a967-7a4f-4189-b4a7-4f8019e131fb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:38.157496 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-37c2a967-7a4f-4189-b4a7-4f8019e131fb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:38.157971 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-37c2a967-7a4f-4189-b4a7-4f8019e131fb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:38.158732 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-37c2a967-7a4f-4189-b4a7-4f8019e131fb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:38.159165 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-37c2a967-7a4f-4189-b4a7-4f8019e131fb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:38.283919 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-37c2a967-7a4f-4189-b4a7-4f8019e131fb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:38.291527 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-37c2a967-7a4f-4189-b4a7-4f8019e131fb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:38.293035 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-37c2a967-7a4f-4189-b4a7-4f8019e131fb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:38.294207 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-37c2a967-7a4f-4189-b4a7-4f8019e131fb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1723 microversion: 2.20 time: 0.147449 May 12 11:50:38.294763 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 357/719] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:38 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:50:38.344491 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a1ba98c5-0739-4801-a58d-e9ca3359080c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:38.345109 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-a1ba98c5-0739-4801-a58d-e9ca3359080c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:38.351490 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a1ba98c5-0739-4801-a58d-e9ca3359080c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:38.351945 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a1ba98c5-0739-4801-a58d-e9ca3359080c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:38.352718 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a1ba98c5-0739-4801-a58d-e9ca3359080c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:38.353157 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a1ba98c5-0739-4801-a58d-e9ca3359080c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:38.366945 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-a1ba98c5-0739-4801-a58d-e9ca3359080c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] HTTP exception thrown: Instance 6bf4fa9e-950e-4be3-b042-517c2079c0f2 could not be found. May 12 11:50:38.368550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a1ba98c5-0739-4801-a58d-e9ca3359080c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Request method failure captured: May 12 11:50:38.368550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 HTTP/1.1 May 12 11:50:38.368550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:50:38.368550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:50:38.368550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:50:38.368550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:50:38.368550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:50:38.368550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:50:38.368550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:50:38.368550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:50:38.368550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPN72ankLKFrhJZR6C9M0dw-hZiyRt2TUcTdfesTpyCjr9OGMmXaA66OtYjMn8nYY67uZhB9uLgl0jwQoZVi3Y7RS0U9fP_Lye0Yg766PW_npIuypBUoIxJt9qk5Xad8asCqybumyRetKRLRv4rX8oQrT-L3kxEIm7ZFNVWac1-Kq08 May 12 11:50:38.368550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:50:38.368550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:50:38.368550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:50:38.368550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:50:38.368550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:50:38.368550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:50:38.368550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: d51975fc708d49efa56621b0fd19c47f May 12 11:50:38.368550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-AttachVolumeTestJSON-1858507414 May 12 11:50:38.368550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:50:38.368550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:50:38.370150 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d51975fc708d49efa56621b0fd19c47f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d51975fc708d49efa56621b0fd19c47f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d51975fc708d49efa56621b0fd19c47f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d51975fc708d49efa56621b0fd19c47f", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:50:38.370150 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-AttachVolumeTestJSON-1858507414 May 12 11:50:38.370150 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: d51975fc708d49efa56621b0fd19c47f May 12 11:50:38.370150 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1858507414 May 12 11:50:38.370150 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-AttachVolumeTestJSON-1858507414-project May 12 11:50:38.370150 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:50:38.370150 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:50:38.370150 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 97227abbbafa46f1b0660e3be2ceea70 May 12 11:50:38.370150 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-AttachVolumeTestJSON-1858507414-project May 12 11:50:38.370150 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:50:38.370150 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance 6bf4fa9e-950e-4be3-b042-517c2079c0f2 could not be found. May 12 11:50:38.370150 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': '6bf4fa9e-950e-4be3-b042-517c2079c0f2'} May 12 11:50:38.371797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:50:38.371797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:50:38.371797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:50:38.371797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:50:38.371797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:50:38.371797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:50:38.371797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:50:38.371797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:50:38.371797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:50:38.371797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:50:38.371797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bf4fa9e-950e-4be3-b042-517c2079c0f2 could not be found. May 12 11:50:38.371797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:50:38.371797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:50:38.371797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:50:38.371797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:50:38.371797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:50:38.371797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:50:38.371797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:50:38.371797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:50:38.371797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:50:38.373317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:50:38.373317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:50:38.373317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:50:38.373317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:50:38.373317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:50:38.373317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:50:38.373317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:50:38.373317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bf4fa9e-950e-4be3-b042-517c2079c0f2 could not be found. May 12 11:50:38.373317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:50:38.373317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:50:38.373317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:50:38.373317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:50:38.373317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:50:38.373317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:50:38.373317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:50:38.373317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:50:38.373317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bf4fa9e-950e-4be3-b042-517c2079c0f2 could not be found. May 12 11:50:38.373317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:50:38.374683 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a1ba98c5-0739-4801-a58d-e9ca3359080c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Returning 404 to user: Instance 6bf4fa9e-950e-4be3-b042-517c2079c0f2 could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:50:38.374683 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-a1ba98c5-0739-4801-a58d-e9ca3359080c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 404 len: 111 microversion: 2.1 time: 0.029351 May 12 11:50:38.374683 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 363/720] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:38 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:50:38.378340 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-efed7848-4af1-446b-b634-a383234df488 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '.version_select at 0x7f29f7802310>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:38.395004 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-efed7848-4af1-446b-b634-a383234df488 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-248840448" status: 202 len: 0 microversion: 2.1 time: 0.020271 May 12 11:50:38.395597 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 358/721] 10.222.0.58 () {58 vars in 1217 bytes} [Thu May 12 11:50:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-248840448 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:50:39.063741 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-53f6be14-05a0-444d-bb00-b46cdf844174 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:39.064978 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-53f6be14-05a0-444d-bb00-b46cdf844174 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:39.071278 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-53f6be14-05a0-444d-bb00-b46cdf844174 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:39.071733 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-53f6be14-05a0-444d-bb00-b46cdf844174 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:39.072514 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-53f6be14-05a0-444d-bb00-b46cdf844174 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:39.072956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-53f6be14-05a0-444d-bb00-b46cdf844174 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:39.206204 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-53f6be14-05a0-444d-bb00-b46cdf844174 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:39.213848 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-53f6be14-05a0-444d-bb00-b46cdf844174 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1258 microversion: 2.1 time: 0.153971 May 12 11:50:39.214531 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 364/722] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:39 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:39.236920 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-5a2f25d6-9c85-4e5a-9597-1461b75cf3b3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Action: 'create', calling method: .version_select at 0x7f29f1da6430>, body: {"keypair": {"name": "tempest-keypair-1742982891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOxN9Ii6gg8iDct/52Q8VeRL1wjj28xebTOhm24fzB3bgKopqoxLPzfj3eKFnWUgCl4dWzzBENB3W5rhZfuHvX+ET5hxU3h555vbZkWujNWTfjTpIj4ro3TW3PrAPlijQ=="}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:50:39.250638 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-5a2f25d6-9c85-4e5a-9597-1461b75cf3b3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Getting quotas for project d51975fc708d49efa56621b0fd19c47f. Resources: {'key_pairs'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:50:39.254863 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-5a2f25d6-9c85-4e5a-9597-1461b75cf3b3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Getting quotas for user 97227abbbafa46f1b0660e3be2ceea70 and project d51975fc708d49efa56621b0fd19c47f. Resources: {'key_pairs'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:50:39.275978 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-5a2f25d6-9c85-4e5a-9597-1461b75cf3b3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043344 May 12 11:50:39.276612 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 359/723] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 12 11:50:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:50:39.312380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-833a67d8-eca9-4289-aa24-c40e65b65970 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:39.313025 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-833a67d8-eca9-4289-aa24-c40e65b65970 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:39.319291 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-833a67d8-eca9-4289-aa24-c40e65b65970 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:39.319744 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-833a67d8-eca9-4289-aa24-c40e65b65970 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:39.320518 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-833a67d8-eca9-4289-aa24-c40e65b65970 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:39.320953 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-833a67d8-eca9-4289-aa24-c40e65b65970 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:39.456900 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-833a67d8-eca9-4289-aa24-c40e65b65970 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:39.464719 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-833a67d8-eca9-4289-aa24-c40e65b65970 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:39.466245 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-833a67d8-eca9-4289-aa24-c40e65b65970 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:39.467544 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-833a67d8-eca9-4289-aa24-c40e65b65970 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1723 microversion: 2.20 time: 0.159079 May 12 11:50:39.468099 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 365/724] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:39 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:50:40.230644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-f59b7be5-ba25-4c44-9a5b-56d59380f4f5 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:40.231175 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-f59b7be5-ba25-4c44-9a5b-56d59380f4f5 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:40.237157 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f59b7be5-ba25-4c44-9a5b-56d59380f4f5 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:40.237793 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f59b7be5-ba25-4c44-9a5b-56d59380f4f5 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:40.238400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f59b7be5-ba25-4c44-9a5b-56d59380f4f5 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:40.238840 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f59b7be5-ba25-4c44-9a5b-56d59380f4f5 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:40.430316 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-f59b7be5-ba25-4c44-9a5b-56d59380f4f5 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:40.437902 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-f59b7be5-ba25-4c44-9a5b-56d59380f4f5 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1258 microversion: 2.1 time: 0.211228 May 12 11:50:40.438482 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 360/725] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:40 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1258 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:40.485540 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-90ccdb2d-8703-4958-872c-cdbbc6fc1761 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:40.486182 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-90ccdb2d-8703-4958-872c-cdbbc6fc1761 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:40.492475 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-90ccdb2d-8703-4958-872c-cdbbc6fc1761 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:40.492925 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-90ccdb2d-8703-4958-872c-cdbbc6fc1761 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:40.493685 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-90ccdb2d-8703-4958-872c-cdbbc6fc1761 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:40.494310 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-90ccdb2d-8703-4958-872c-cdbbc6fc1761 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:40.616708 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-d1d049e8-a48a-4c13-a892-a9310c3679db tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-206071157", "imageRef": "576e8b7b-771b-47aa-89c6-ff04accc9bea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f747c31e-f2f6-4373-ba29-1719eaa22635"}], "security_groups": [{"name": "tempest-securitygroup--1452944705"}], "key_name": "tempest-keypair-1742982891", "user_data": "}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:50:40.627783 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-90ccdb2d-8703-4958-872c-cdbbc6fc1761 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:40.635992 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-90ccdb2d-8703-4958-872c-cdbbc6fc1761 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:40.637511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-90ccdb2d-8703-4958-872c-cdbbc6fc1761 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:40.638718 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-90ccdb2d-8703-4958-872c-cdbbc6fc1761 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1723 microversion: 2.20 time: 0.157120 May 12 11:50:40.639287 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 366/726] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:40 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:50:40.714590 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.network.neutron [None req-d1d049e8-a48a-4c13-a892-a9310c3679db tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] validate_networks() for [('f747c31e-f2f6-4373-ba29-1719eaa22635', None, None, None, None, None)] {{(pid=123507) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 11:50:41.076042 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-d1d049e8-a48a-4c13-a892-a9310c3679db tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Flavor limits 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 11:50:41.076458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-d1d049e8-a48a-4c13-a892-a9310c3679db tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Image limits 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 11:50:41.076927 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-d1d049e8-a48a-4c13-a892-a9310c3679db tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Flavor pref 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 11:50:41.077333 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-d1d049e8-a48a-4c13-a892-a9310c3679db tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Image pref 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 11:50:41.077771 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-d1d049e8-a48a-4c13-a892-a9310c3679db tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 11:50:41.086701 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d1d049e8-a48a-4c13-a892-a9310c3679db tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:41.087145 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d1d049e8-a48a-4c13-a892-a9310c3679db tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:41.087946 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d1d049e8-a48a-4c13-a892-a9310c3679db tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:41.088438 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d1d049e8-a48a-4c13-a892-a9310c3679db tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:41.104239 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-d1d049e8-a48a-4c13-a892-a9310c3679db tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Getting quotas for project d51975fc708d49efa56621b0fd19c47f. Resources: {'ram', 'cores', 'instances'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:50:41.108270 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-d1d049e8-a48a-4c13-a892-a9310c3679db tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Getting quotas for user 97227abbbafa46f1b0660e3be2ceea70 and project d51975fc708d49efa56621b0fd19c47f. Resources: {'ram', 'cores', 'instances'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:50:41.119544 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d1d049e8-a48a-4c13-a892-a9310c3679db tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Going to run 1 instances... {{(pid=123507) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 11:50:41.121998 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d1d049e8-a48a-4c13-a892-a9310c3679db tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='576e8b7b-771b-47aa-89c6-ff04accc9bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123507) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 11:50:41.180748 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-d1d049e8-a48a-4c13-a892-a9310c3679db tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.568030 May 12 11:50:41.182278 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 361/727] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 12 11:50:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 11:50:41.193299 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-a6202338-76a7-4989-b1a2-f0d5d79260e9 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:41.194149 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-a6202338-76a7-4989-b1a2-f0d5d79260e9 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:41.265059 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-cbf914c4-3183-49a4-bc5e-be54500825dd req-f159fb41-1da7-4a37-9eb6-14b51f2e3153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d747a75-e74d-4c41-9707-aee578ce2d01", "name": "network-vif-plugged", "status": "completed", "tag": "0b817862-786a-4db4-bdba-c4efd02f2cda"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:50:41.268842 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-a6202338-76a7-4989-b1a2-f0d5d79260e9 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:41.276825 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-a6202338-76a7-4989-b1a2-f0d5d79260e9 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 200 len: 1237 microversion: 2.1 time: 0.088917 May 12 11:50:41.277462 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 362/728] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:41 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:50:41.278274 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-cbf914c4-3183-49a4-bc5e-be54500825dd req-f159fb41-1da7-4a37-9eb6-14b51f2e3153 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:41.278732 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-cbf914c4-3183-49a4-bc5e-be54500825dd req-f159fb41-1da7-4a37-9eb6-14b51f2e3153 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:41.290465 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-cbf914c4-3183-49a4-bc5e-be54500825dd req-f159fb41-1da7-4a37-9eb6-14b51f2e3153 service nova] Creating event network-vif-plugged:0b817862-786a-4db4-bdba-c4efd02f2cda for instance 8d747a75-e74d-4c41-9707-aee578ce2d01 on hv-cinder-80473 May 12 11:50:41.295183 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-cbf914c4-3183-49a4-bc5e-be54500825dd req-f159fb41-1da7-4a37-9eb6-14b51f2e3153 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176003 May 12 11:50:41.295866 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 367/729] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:50:41.460226 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-584259c5-1779-41a9-82c2-6230dfa8b64d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:41.460877 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-584259c5-1779-41a9-82c2-6230dfa8b64d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:41.468209 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-584259c5-1779-41a9-82c2-6230dfa8b64d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:41.468844 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-584259c5-1779-41a9-82c2-6230dfa8b64d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:41.470796 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-584259c5-1779-41a9-82c2-6230dfa8b64d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:41.471273 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-584259c5-1779-41a9-82c2-6230dfa8b64d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:41.619138 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-584259c5-1779-41a9-82c2-6230dfa8b64d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:41.628224 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-584259c5-1779-41a9-82c2-6230dfa8b64d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1258 microversion: 2.1 time: 0.177518 May 12 11:50:41.628869 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 363/730] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:41 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:41.657442 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-6630ea01-75be-4c6e-8b8f-e8493bc184b3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:41.658824 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-6630ea01-75be-4c6e-8b8f-e8493bc184b3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:41.665078 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6630ea01-75be-4c6e-8b8f-e8493bc184b3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:41.665533 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6630ea01-75be-4c6e-8b8f-e8493bc184b3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:41.666338 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6630ea01-75be-4c6e-8b8f-e8493bc184b3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:41.666781 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-6630ea01-75be-4c6e-8b8f-e8493bc184b3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:41.797844 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-6630ea01-75be-4c6e-8b8f-e8493bc184b3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:41.805590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-6630ea01-75be-4c6e-8b8f-e8493bc184b3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:41.807133 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-6630ea01-75be-4c6e-8b8f-e8493bc184b3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:41.808360 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-6630ea01-75be-4c6e-8b8f-e8493bc184b3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1723 microversion: 2.20 time: 0.155606 May 12 11:50:41.808922 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 368/731] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:41 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:50:42.294323 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-d4e14cc7-16a7-4104-83af-b5b43794c6d3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:42.295064 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d4e14cc7-16a7-4104-83af-b5b43794c6d3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:42.301564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d4e14cc7-16a7-4104-83af-b5b43794c6d3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:42.302102 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d4e14cc7-16a7-4104-83af-b5b43794c6d3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:42.302990 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d4e14cc7-16a7-4104-83af-b5b43794c6d3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:42.303479 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d4e14cc7-16a7-4104-83af-b5b43794c6d3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:42.365544 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-d4e14cc7-16a7-4104-83af-b5b43794c6d3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:42.372741 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-d4e14cc7-16a7-4104-83af-b5b43794c6d3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 200 len: 1289 microversion: 2.1 time: 0.083108 May 12 11:50:42.373302 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 364/732] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:42 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 1289 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:42.645459 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ee5d0118-f052-42c0-b487-25e37c79d26b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:42.646032 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-ee5d0118-f052-42c0-b487-25e37c79d26b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:42.651900 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ee5d0118-f052-42c0-b487-25e37c79d26b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:42.652354 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ee5d0118-f052-42c0-b487-25e37c79d26b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:42.653124 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ee5d0118-f052-42c0-b487-25e37c79d26b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:42.653568 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ee5d0118-f052-42c0-b487-25e37c79d26b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:42.784101 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-ee5d0118-f052-42c0-b487-25e37c79d26b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:42.791562 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-ee5d0118-f052-42c0-b487-25e37c79d26b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1258 microversion: 2.1 time: 0.150017 May 12 11:50:42.792141 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 369/733] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:42 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:42.826166 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-b740939c-0d79-49bf-8bf7-f8ca08316acb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:42.826847 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-b740939c-0d79-49bf-8bf7-f8ca08316acb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:42.833190 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b740939c-0d79-49bf-8bf7-f8ca08316acb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:42.833641 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b740939c-0d79-49bf-8bf7-f8ca08316acb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:42.834501 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b740939c-0d79-49bf-8bf7-f8ca08316acb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:42.834932 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b740939c-0d79-49bf-8bf7-f8ca08316acb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:42.962432 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b740939c-0d79-49bf-8bf7-f8ca08316acb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:42.970064 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b740939c-0d79-49bf-8bf7-f8ca08316acb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:42.971661 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b740939c-0d79-49bf-8bf7-f8ca08316acb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:42.972803 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-b740939c-0d79-49bf-8bf7-f8ca08316acb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1723 microversion: 2.20 time: 0.150494 May 12 11:50:42.973357 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 365/734] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:42 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:50:43.389185 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b22f3521-25fb-4e24-841c-f7549504eab6 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:43.390511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-b22f3521-25fb-4e24-841c-f7549504eab6 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:43.400260 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b22f3521-25fb-4e24-841c-f7549504eab6 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:43.402606 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b22f3521-25fb-4e24-841c-f7549504eab6 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:43.403656 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b22f3521-25fb-4e24-841c-f7549504eab6 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:43.404273 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b22f3521-25fb-4e24-841c-f7549504eab6 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:43.479585 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b22f3521-25fb-4e24-841c-f7549504eab6 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:43.486794 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-b22f3521-25fb-4e24-841c-f7549504eab6 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 200 len: 1307 microversion: 2.1 time: 0.101438 May 12 11:50:43.487361 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 370/735] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:43 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:43.808225 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-b7422f66-fbee-430e-b9de-f6335e89fb73 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:43.808839 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-b7422f66-fbee-430e-b9de-f6335e89fb73 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:43.815741 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b7422f66-fbee-430e-b9de-f6335e89fb73 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:43.816190 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b7422f66-fbee-430e-b9de-f6335e89fb73 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:43.816951 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b7422f66-fbee-430e-b9de-f6335e89fb73 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:43.817390 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b7422f66-fbee-430e-b9de-f6335e89fb73 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:43.943221 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b7422f66-fbee-430e-b9de-f6335e89fb73 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:43.950502 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-b7422f66-fbee-430e-b9de-f6335e89fb73 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1443 microversion: 2.1 time: 0.146123 May 12 11:50:43.951070 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 366/736] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:43 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1443 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:43.966422 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-4abd4c06-d650-43b1-828d-1cde838ea760 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:43.967032 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-4abd4c06-d650-43b1-828d-1cde838ea760 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:43.973236 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4abd4c06-d650-43b1-828d-1cde838ea760 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:43.973690 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4abd4c06-d650-43b1-828d-1cde838ea760 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:43.974485 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4abd4c06-d650-43b1-828d-1cde838ea760 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:43.974924 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4abd4c06-d650-43b1-828d-1cde838ea760 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:43.992439 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-79ab227d-fa65-4cf5-91d7-0c1c8f94d33b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:43.993277 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-79ab227d-fa65-4cf5-91d7-0c1c8f94d33b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:43.999277 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-79ab227d-fa65-4cf5-91d7-0c1c8f94d33b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:43.999727 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-79ab227d-fa65-4cf5-91d7-0c1c8f94d33b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:44.000562 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-79ab227d-fa65-4cf5-91d7-0c1c8f94d33b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:44.001005 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-79ab227d-fa65-4cf5-91d7-0c1c8f94d33b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:44.105762 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-4abd4c06-d650-43b1-828d-1cde838ea760 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:44.113645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-4abd4c06-d650-43b1-828d-1cde838ea760 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1443 microversion: 2.1 time: 0.150978 May 12 11:50:44.114252 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 371/737] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:43 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1443 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:44.129061 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-79ab227d-fa65-4cf5-91d7-0c1c8f94d33b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:44.137156 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-79ab227d-fa65-4cf5-91d7-0c1c8f94d33b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:44.138691 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-79ab227d-fa65-4cf5-91d7-0c1c8f94d33b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:44.139977 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-79ab227d-fa65-4cf5-91d7-0c1c8f94d33b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1723 microversion: 2.20 time: 0.152009 May 12 11:50:44.140648 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 367/738] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:43 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:50:44.503363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-50af1966-834c-4a63-8b69-d6448b981bca tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:44.503511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-50af1966-834c-4a63-8b69-d6448b981bca tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:44.509695 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-50af1966-834c-4a63-8b69-d6448b981bca tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:44.510178 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-50af1966-834c-4a63-8b69-d6448b981bca tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:44.510983 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-50af1966-834c-4a63-8b69-d6448b981bca tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:44.511455 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-50af1966-834c-4a63-8b69-d6448b981bca tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:44.605045 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-50af1966-834c-4a63-8b69-d6448b981bca tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:44.613377 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-50af1966-834c-4a63-8b69-d6448b981bca tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 200 len: 1295 microversion: 2.1 time: 0.114271 May 12 11:50:44.613998 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 372/739] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:44 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 1295 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:45.158984 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-09c1d68e-f0b9-4950-bcf5-f8533ce1b697 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:45.159533 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-09c1d68e-f0b9-4950-bcf5-f8533ce1b697 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:45.165876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-09c1d68e-f0b9-4950-bcf5-f8533ce1b697 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:45.166330 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-09c1d68e-f0b9-4950-bcf5-f8533ce1b697 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:45.167100 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-09c1d68e-f0b9-4950-bcf5-f8533ce1b697 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:45.167537 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-09c1d68e-f0b9-4950-bcf5-f8533ce1b697 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:45.299609 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-09c1d68e-f0b9-4950-bcf5-f8533ce1b697 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:45.309804 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-09c1d68e-f0b9-4950-bcf5-f8533ce1b697 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:45.311752 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-09c1d68e-f0b9-4950-bcf5-f8533ce1b697 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:45.313005 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-09c1d68e-f0b9-4950-bcf5-f8533ce1b697 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1723 microversion: 2.20 time: 0.157977 May 12 11:50:45.320731 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 368/740] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:45 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:50:45.630238 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-3b3bccc4-f596-4a0a-aaf3-4b6e37b41346 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:45.630850 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-3b3bccc4-f596-4a0a-aaf3-4b6e37b41346 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:45.637091 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3b3bccc4-f596-4a0a-aaf3-4b6e37b41346 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:45.637548 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3b3bccc4-f596-4a0a-aaf3-4b6e37b41346 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:45.638527 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3b3bccc4-f596-4a0a-aaf3-4b6e37b41346 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:45.638972 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3b3bccc4-f596-4a0a-aaf3-4b6e37b41346 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:45.836882 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-3b3bccc4-f596-4a0a-aaf3-4b6e37b41346 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:45.844284 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-3b3bccc4-f596-4a0a-aaf3-4b6e37b41346 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 200 len: 1363 microversion: 2.1 time: 0.217876 May 12 11:50:45.844866 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 373/741] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:45 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:46.331164 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-06bbcb50-80fb-463d-8d9b-8b91a98f573d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:46.331685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-06bbcb50-80fb-463d-8d9b-8b91a98f573d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:46.338013 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-06bbcb50-80fb-463d-8d9b-8b91a98f573d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:46.338463 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-06bbcb50-80fb-463d-8d9b-8b91a98f573d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:46.339235 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-06bbcb50-80fb-463d-8d9b-8b91a98f573d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:46.339672 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-06bbcb50-80fb-463d-8d9b-8b91a98f573d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:46.476067 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-06bbcb50-80fb-463d-8d9b-8b91a98f573d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:46.483330 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-06bbcb50-80fb-463d-8d9b-8b91a98f573d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:46.484842 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-06bbcb50-80fb-463d-8d9b-8b91a98f573d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:46.486555 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-06bbcb50-80fb-463d-8d9b-8b91a98f573d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1723 microversion: 2.20 time: 0.159046 May 12 11:50:46.487116 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 369/742] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:46 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:50:46.860158 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-c99cf333-6b1a-4cef-b3a7-6d37301bd75e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:46.860765 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-c99cf333-6b1a-4cef-b3a7-6d37301bd75e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:46.867798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c99cf333-6b1a-4cef-b3a7-6d37301bd75e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:46.868248 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c99cf333-6b1a-4cef-b3a7-6d37301bd75e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:46.869950 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c99cf333-6b1a-4cef-b3a7-6d37301bd75e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:46.870402 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c99cf333-6b1a-4cef-b3a7-6d37301bd75e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:47.006383 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-697e0c84-c319-4e02-8b90-250c44611cef req-a26df821-9c05-4052-b391-4c8d40e6308b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d747a75-e74d-4c41-9707-aee578ce2d01", "tag": "0b817862-786a-4db4-bdba-c4efd02f2cda"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:50:47.016220 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-697e0c84-c319-4e02-8b90-250c44611cef req-a26df821-9c05-4052-b391-4c8d40e6308b service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:47.016946 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-697e0c84-c319-4e02-8b90-250c44611cef req-a26df821-9c05-4052-b391-4c8d40e6308b service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:47.029922 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-697e0c84-c319-4e02-8b90-250c44611cef req-a26df821-9c05-4052-b391-4c8d40e6308b service nova] Creating event network-changed:0b817862-786a-4db4-bdba-c4efd02f2cda for instance 8d747a75-e74d-4c41-9707-aee578ce2d01 on hv-cinder-80473 May 12 11:50:47.036450 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-697e0c84-c319-4e02-8b90-250c44611cef req-a26df821-9c05-4052-b391-4c8d40e6308b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034093 May 12 11:50:47.037691 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 370/743] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:50:47.121506 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c99cf333-6b1a-4cef-b3a7-6d37301bd75e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:47.131138 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-c99cf333-6b1a-4cef-b3a7-6d37301bd75e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 200 len: 1363 microversion: 2.1 time: 0.274838 May 12 11:50:47.132927 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 374/744] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:46 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:50:47.529203 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-cf2049c6-3472-431b-8222-b7385e6e30da tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:47.530927 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-cf2049c6-3472-431b-8222-b7385e6e30da tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:47.551534 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cf2049c6-3472-431b-8222-b7385e6e30da tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:47.552380 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cf2049c6-3472-431b-8222-b7385e6e30da tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:47.555545 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cf2049c6-3472-431b-8222-b7385e6e30da tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:47.557586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cf2049c6-3472-431b-8222-b7385e6e30da tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:47.893098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-cf2049c6-3472-431b-8222-b7385e6e30da tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:47.903948 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-cf2049c6-3472-431b-8222-b7385e6e30da tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:47.909035 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-cf2049c6-3472-431b-8222-b7385e6e30da tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:47.910257 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-cf2049c6-3472-431b-8222-b7385e6e30da tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1744 microversion: 2.20 time: 0.401105 May 12 11:50:47.910814 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 371/745] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:47 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1744 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:50:48.148926 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-7aa0f9f0-4fb9-40eb-8e7e-c5c8113f677e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:48.149578 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-7aa0f9f0-4fb9-40eb-8e7e-c5c8113f677e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:48.156219 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7aa0f9f0-4fb9-40eb-8e7e-c5c8113f677e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:48.156756 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7aa0f9f0-4fb9-40eb-8e7e-c5c8113f677e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:48.158438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7aa0f9f0-4fb9-40eb-8e7e-c5c8113f677e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:48.158874 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7aa0f9f0-4fb9-40eb-8e7e-c5c8113f677e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:48.290442 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-7aa0f9f0-4fb9-40eb-8e7e-c5c8113f677e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:48.297614 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-7aa0f9f0-4fb9-40eb-8e7e-c5c8113f677e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 200 len: 1363 microversion: 2.1 time: 0.152621 May 12 11:50:48.298267 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 375/746] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:48 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:50:48.928928 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-3bce009c-99f2-4639-8bba-e6311896c551 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:48.929540 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-3bce009c-99f2-4639-8bba-e6311896c551 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:48.935784 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3bce009c-99f2-4639-8bba-e6311896c551 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:48.936235 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3bce009c-99f2-4639-8bba-e6311896c551 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:48.936996 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3bce009c-99f2-4639-8bba-e6311896c551 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:48.937431 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3bce009c-99f2-4639-8bba-e6311896c551 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:49.058799 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-dd6db0bc-2c51-41d2-859a-bfee6d27dab9 req-44505c02-b02c-4bcd-8a74-6bfa9de7eb6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53e646cc-6d91-43a7-bcf8-3b2b90228e12", "tag": "00d7eab1-f59b-4a04-84f7-bd2c41023215"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:50:49.068503 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-dd6db0bc-2c51-41d2-859a-bfee6d27dab9 req-44505c02-b02c-4bcd-8a74-6bfa9de7eb6c service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:49.069268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-dd6db0bc-2c51-41d2-859a-bfee6d27dab9 req-44505c02-b02c-4bcd-8a74-6bfa9de7eb6c service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:49.083217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-dd6db0bc-2c51-41d2-859a-bfee6d27dab9 req-44505c02-b02c-4bcd-8a74-6bfa9de7eb6c service nova] Creating event network-changed:00d7eab1-f59b-4a04-84f7-bd2c41023215 for instance 53e646cc-6d91-43a7-bcf8-3b2b90228e12 on hv-cinder-80473 May 12 11:50:49.088454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-dd6db0bc-2c51-41d2-859a-bfee6d27dab9 req-44505c02-b02c-4bcd-8a74-6bfa9de7eb6c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033321 May 12 11:50:49.089267 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 376/747] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:50:49.097909 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-3bce009c-99f2-4639-8bba-e6311896c551 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:49.106077 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-3bce009c-99f2-4639-8bba-e6311896c551 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:49.107565 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-3bce009c-99f2-4639-8bba-e6311896c551 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:49.108728 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-3bce009c-99f2-4639-8bba-e6311896c551 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1744 microversion: 2.20 time: 0.184330 May 12 11:50:49.109295 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 372/748] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:48 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1744 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:50:49.317011 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-d0f126d3-90c3-4ac8-88af-222d6e7c5477 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:49.317900 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d0f126d3-90c3-4ac8-88af-222d6e7c5477 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:49.324256 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d0f126d3-90c3-4ac8-88af-222d6e7c5477 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:49.324985 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d0f126d3-90c3-4ac8-88af-222d6e7c5477 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:49.325907 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d0f126d3-90c3-4ac8-88af-222d6e7c5477 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:49.326472 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d0f126d3-90c3-4ac8-88af-222d6e7c5477 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:49.412394 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-a90f4d5f-d7f1-43cd-8c52-b17027cf3d07 req-845479a5-cd3d-4f29-8818-f142fe37dec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efbc8e04-31bd-4238-8c9a-096ad87a46ab", "name": "network-vif-plugged", "status": "completed", "tag": "e62c63ee-3f94-4556-b00c-c45c7465fd0e"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:50:49.421671 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-a90f4d5f-d7f1-43cd-8c52-b17027cf3d07 req-845479a5-cd3d-4f29-8818-f142fe37dec2 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:49.422422 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-a90f4d5f-d7f1-43cd-8c52-b17027cf3d07 req-845479a5-cd3d-4f29-8818-f142fe37dec2 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:49.436467 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-a90f4d5f-d7f1-43cd-8c52-b17027cf3d07 req-845479a5-cd3d-4f29-8818-f142fe37dec2 service nova] Creating event network-vif-plugged:e62c63ee-3f94-4556-b00c-c45c7465fd0e for instance efbc8e04-31bd-4238-8c9a-096ad87a46ab on hv-cinder-80473 May 12 11:50:49.445871 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-a90f4d5f-d7f1-43cd-8c52-b17027cf3d07 req-845479a5-cd3d-4f29-8818-f142fe37dec2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037967 May 12 11:50:49.446808 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 373/749] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:50:49.483520 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-d0f126d3-90c3-4ac8-88af-222d6e7c5477 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:49.491515 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-d0f126d3-90c3-4ac8-88af-222d6e7c5477 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 200 len: 1363 microversion: 2.1 time: 0.180023 May 12 11:50:49.492669 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 377/750] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:49 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:50.127704 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-87ffdea8-f297-4308-9657-6897857cd9e4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:50.128411 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-87ffdea8-f297-4308-9657-6897857cd9e4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:50.134959 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-87ffdea8-f297-4308-9657-6897857cd9e4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:50.135409 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-87ffdea8-f297-4308-9657-6897857cd9e4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:50.136172 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-87ffdea8-f297-4308-9657-6897857cd9e4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:50.136610 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-87ffdea8-f297-4308-9657-6897857cd9e4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:50.266842 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-87ffdea8-f297-4308-9657-6897857cd9e4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:50.275069 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-87ffdea8-f297-4308-9657-6897857cd9e4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:50.276492 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-87ffdea8-f297-4308-9657-6897857cd9e4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:50.277637 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-87ffdea8-f297-4308-9657-6897857cd9e4 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1744 microversion: 2.20 time: 0.154204 May 12 11:50:50.278216 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 374/751] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:50 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:50:50.509023 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a381ddcb-122d-4e8f-b860-ed188864eee8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:50.509635 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-a381ddcb-122d-4e8f-b860-ed188864eee8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:50.515435 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a381ddcb-122d-4e8f-b860-ed188864eee8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:50.515884 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a381ddcb-122d-4e8f-b860-ed188864eee8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:50.516644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a381ddcb-122d-4e8f-b860-ed188864eee8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:50.517074 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a381ddcb-122d-4e8f-b860-ed188864eee8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:50.653471 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-a381ddcb-122d-4e8f-b860-ed188864eee8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:50.660799 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-a381ddcb-122d-4e8f-b860-ed188864eee8 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 200 len: 1363 microversion: 2.1 time: 0.155910 May 12 11:50:50.661369 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 378/752] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:50 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:51.296051 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-56bbc788-5127-4d16-8601-9cc109f15f04 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:51.296665 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-56bbc788-5127-4d16-8601-9cc109f15f04 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:51.303078 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-56bbc788-5127-4d16-8601-9cc109f15f04 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:51.303527 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-56bbc788-5127-4d16-8601-9cc109f15f04 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:51.304297 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-56bbc788-5127-4d16-8601-9cc109f15f04 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:51.304729 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-56bbc788-5127-4d16-8601-9cc109f15f04 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:51.428482 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-56bbc788-5127-4d16-8601-9cc109f15f04 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:51.436110 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-56bbc788-5127-4d16-8601-9cc109f15f04 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:51.437621 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-56bbc788-5127-4d16-8601-9cc109f15f04 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:51.438810 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-56bbc788-5127-4d16-8601-9cc109f15f04 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1744 microversion: 2.20 time: 0.146666 May 12 11:50:51.440075 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 375/753] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:51 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1744 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:50:51.676900 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-75b5bce1-9868-4fb0-bebe-44298d854baa tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:51.677427 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-75b5bce1-9868-4fb0-bebe-44298d854baa tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:51.683707 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-75b5bce1-9868-4fb0-bebe-44298d854baa tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:51.684170 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-75b5bce1-9868-4fb0-bebe-44298d854baa tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:51.684944 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-75b5bce1-9868-4fb0-bebe-44298d854baa tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:51.685387 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-75b5bce1-9868-4fb0-bebe-44298d854baa tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:51.812440 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-75b5bce1-9868-4fb0-bebe-44298d854baa tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:51.820548 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-75b5bce1-9868-4fb0-bebe-44298d854baa tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 200 len: 1363 microversion: 2.1 time: 0.148077 May 12 11:50:51.821114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 379/754] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:51 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:52.458120 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-e0ad0923-3db7-4672-a7fe-83ad97a267fd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:52.458724 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-e0ad0923-3db7-4672-a7fe-83ad97a267fd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:52.465203 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e0ad0923-3db7-4672-a7fe-83ad97a267fd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:52.465914 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e0ad0923-3db7-4672-a7fe-83ad97a267fd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:52.466805 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e0ad0923-3db7-4672-a7fe-83ad97a267fd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:52.467175 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e0ad0923-3db7-4672-a7fe-83ad97a267fd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:52.596460 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-e0ad0923-3db7-4672-a7fe-83ad97a267fd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:52.604549 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-e0ad0923-3db7-4672-a7fe-83ad97a267fd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:52.606302 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-e0ad0923-3db7-4672-a7fe-83ad97a267fd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:52.607691 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-e0ad0923-3db7-4672-a7fe-83ad97a267fd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1739 microversion: 2.20 time: 0.154106 May 12 11:50:52.608354 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 376/755] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:52 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:50:52.837121 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-9db5f9c8-7a3d-4acb-a30f-389584abb08e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:52.837745 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-9db5f9c8-7a3d-4acb-a30f-389584abb08e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:52.844249 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9db5f9c8-7a3d-4acb-a30f-389584abb08e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:52.844703 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9db5f9c8-7a3d-4acb-a30f-389584abb08e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:52.845561 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9db5f9c8-7a3d-4acb-a30f-389584abb08e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:52.846035 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9db5f9c8-7a3d-4acb-a30f-389584abb08e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:52.984182 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-9db5f9c8-7a3d-4acb-a30f-389584abb08e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:52.994942 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-9db5f9c8-7a3d-4acb-a30f-389584abb08e tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 200 len: 1363 microversion: 2.1 time: 0.161480 May 12 11:50:52.996155 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 380/756] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:52 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:53.625808 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-66073b0a-2c20-4c62-965e-443a099ec1da tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:53.627215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-66073b0a-2c20-4c62-965e-443a099ec1da tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:53.633748 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-66073b0a-2c20-4c62-965e-443a099ec1da tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:53.634279 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-66073b0a-2c20-4c62-965e-443a099ec1da tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:53.635161 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-66073b0a-2c20-4c62-965e-443a099ec1da tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:53.635650 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-66073b0a-2c20-4c62-965e-443a099ec1da tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:53.776550 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-66073b0a-2c20-4c62-965e-443a099ec1da tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:53.784917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-66073b0a-2c20-4c62-965e-443a099ec1da tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:53.786558 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-66073b0a-2c20-4c62-965e-443a099ec1da tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:53.787718 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-66073b0a-2c20-4c62-965e-443a099ec1da tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1739 microversion: 2.20 time: 0.165808 May 12 11:50:53.788287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 377/757] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:53 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:50:54.013419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-51bed668-280d-49f0-80bf-9df60b0d413f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:54.014055 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-51bed668-280d-49f0-80bf-9df60b0d413f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:54.021425 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-51bed668-280d-49f0-80bf-9df60b0d413f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:54.021926 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-51bed668-280d-49f0-80bf-9df60b0d413f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:54.022716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-51bed668-280d-49f0-80bf-9df60b0d413f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:54.023154 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-51bed668-280d-49f0-80bf-9df60b0d413f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:54.170117 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-51bed668-280d-49f0-80bf-9df60b0d413f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:54.177599 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-51bed668-280d-49f0-80bf-9df60b0d413f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 200 len: 1363 microversion: 2.1 time: 0.168659 May 12 11:50:54.178394 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 381/758] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:54 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:54.493488 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-151eb2ac-2544-442c-9046-63b6dec4ce93 req-f91ef6c7-df28-4c4f-9d40-f7ba86005001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e646cc-6d91-43a7-bcf8-3b2b90228e12", "name": "network-vif-plugged", "status": "completed", "tag": "00d7eab1-f59b-4a04-84f7-bd2c41023215"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:50:54.504332 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-151eb2ac-2544-442c-9046-63b6dec4ce93 req-f91ef6c7-df28-4c4f-9d40-f7ba86005001 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:54.510804 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-151eb2ac-2544-442c-9046-63b6dec4ce93 req-f91ef6c7-df28-4c4f-9d40-f7ba86005001 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:54.536437 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-151eb2ac-2544-442c-9046-63b6dec4ce93 req-f91ef6c7-df28-4c4f-9d40-f7ba86005001 service nova] Creating event network-vif-plugged:00d7eab1-f59b-4a04-84f7-bd2c41023215 for instance 53e646cc-6d91-43a7-bcf8-3b2b90228e12 on hv-cinder-80473 May 12 11:50:54.544252 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-151eb2ac-2544-442c-9046-63b6dec4ce93 req-f91ef6c7-df28-4c4f-9d40-f7ba86005001 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054361 May 12 11:50:54.545206 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 378/759] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:50:54.807291 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-f22aa8b3-3451-42e0-99f8-df9bfa3853c3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:54.808009 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-f22aa8b3-3451-42e0-99f8-df9bfa3853c3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:54.814756 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f22aa8b3-3451-42e0-99f8-df9bfa3853c3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:54.815447 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f22aa8b3-3451-42e0-99f8-df9bfa3853c3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:54.816385 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f22aa8b3-3451-42e0-99f8-df9bfa3853c3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:54.816979 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f22aa8b3-3451-42e0-99f8-df9bfa3853c3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:54.983026 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-f22aa8b3-3451-42e0-99f8-df9bfa3853c3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:54.992816 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-f22aa8b3-3451-42e0-99f8-df9bfa3853c3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:54.994377 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-f22aa8b3-3451-42e0-99f8-df9bfa3853c3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:54.995545 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-f22aa8b3-3451-42e0-99f8-df9bfa3853c3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1739 microversion: 2.20 time: 0.192449 May 12 11:50:54.997745 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 382/760] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:54 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:50:55.195837 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-f31794a9-becd-4e89-af4c-1dc2b84c21f5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:55.196446 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-f31794a9-becd-4e89-af4c-1dc2b84c21f5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:55.207140 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f31794a9-becd-4e89-af4c-1dc2b84c21f5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:55.207595 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f31794a9-becd-4e89-af4c-1dc2b84c21f5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:55.208387 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f31794a9-becd-4e89-af4c-1dc2b84c21f5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:55.208830 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f31794a9-becd-4e89-af4c-1dc2b84c21f5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:55.357598 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-f31794a9-becd-4e89-af4c-1dc2b84c21f5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:55.365859 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-f31794a9-becd-4e89-af4c-1dc2b84c21f5 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 200 len: 1363 microversion: 2.1 time: 0.174536 May 12 11:50:55.366445 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 379/761] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:55 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:56.014984 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-688c58ad-1798-4805-aad1-c63bd782d755 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:56.015604 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-688c58ad-1798-4805-aad1-c63bd782d755 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:56.024683 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-688c58ad-1798-4805-aad1-c63bd782d755 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:56.025384 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-688c58ad-1798-4805-aad1-c63bd782d755 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:56.026207 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-688c58ad-1798-4805-aad1-c63bd782d755 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:56.026816 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-688c58ad-1798-4805-aad1-c63bd782d755 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:56.169079 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-688c58ad-1798-4805-aad1-c63bd782d755 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:56.178608 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-688c58ad-1798-4805-aad1-c63bd782d755 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:56.180443 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-688c58ad-1798-4805-aad1-c63bd782d755 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:56.181686 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-688c58ad-1798-4805-aad1-c63bd782d755 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1739 microversion: 2.20 time: 0.171317 May 12 11:50:56.192938 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 383/762] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:56 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:50:56.383751 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-7fc2f348-a502-4130-a2ce-d883119c5d06 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:56.385016 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-7fc2f348-a502-4130-a2ce-d883119c5d06 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:56.393636 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7fc2f348-a502-4130-a2ce-d883119c5d06 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:56.394214 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7fc2f348-a502-4130-a2ce-d883119c5d06 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:56.395227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7fc2f348-a502-4130-a2ce-d883119c5d06 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:56.395772 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7fc2f348-a502-4130-a2ce-d883119c5d06 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:56.541749 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-7fc2f348-a502-4130-a2ce-d883119c5d06 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:56.552468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-7fc2f348-a502-4130-a2ce-d883119c5d06 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 200 len: 1363 microversion: 2.1 time: 0.172673 May 12 11:50:56.553326 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 380/763] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:56 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:57.199692 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-e222ec61-4ca7-44a6-ab6c-f12359bc6989 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:57.201276 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-e222ec61-4ca7-44a6-ab6c-f12359bc6989 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:57.209235 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e222ec61-4ca7-44a6-ab6c-f12359bc6989 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:57.209685 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e222ec61-4ca7-44a6-ab6c-f12359bc6989 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:57.210512 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e222ec61-4ca7-44a6-ab6c-f12359bc6989 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:57.210947 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e222ec61-4ca7-44a6-ab6c-f12359bc6989 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:57.355130 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-e222ec61-4ca7-44a6-ab6c-f12359bc6989 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:57.364010 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-e222ec61-4ca7-44a6-ab6c-f12359bc6989 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:57.365728 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-e222ec61-4ca7-44a6-ab6c-f12359bc6989 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:57.366915 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-e222ec61-4ca7-44a6-ab6c-f12359bc6989 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1739 microversion: 2.20 time: 0.171166 May 12 11:50:57.367474 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 384/764] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:57 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:50:57.571294 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-8e87b4de-6969-445d-8155-915a4ac2c675 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:57.572077 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-8e87b4de-6969-445d-8155-915a4ac2c675 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:57.578603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8e87b4de-6969-445d-8155-915a4ac2c675 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:57.579336 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8e87b4de-6969-445d-8155-915a4ac2c675 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:57.580684 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8e87b4de-6969-445d-8155-915a4ac2c675 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:57.581219 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8e87b4de-6969-445d-8155-915a4ac2c675 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:57.743281 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-8e87b4de-6969-445d-8155-915a4ac2c675 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:57.751113 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-8e87b4de-6969-445d-8155-915a4ac2c675 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 200 len: 1363 microversion: 2.1 time: 0.183561 May 12 11:50:57.753630 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 381/765] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:57 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:58.385680 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-d0c68774-e677-4f22-8330-3ef482031ebb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:58.386488 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d0c68774-e677-4f22-8330-3ef482031ebb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:58.394889 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d0c68774-e677-4f22-8330-3ef482031ebb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:58.395348 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d0c68774-e677-4f22-8330-3ef482031ebb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:58.396144 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d0c68774-e677-4f22-8330-3ef482031ebb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:58.396585 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d0c68774-e677-4f22-8330-3ef482031ebb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:58.553126 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-d0c68774-e677-4f22-8330-3ef482031ebb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:58.561434 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-d0c68774-e677-4f22-8330-3ef482031ebb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:58.563240 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-d0c68774-e677-4f22-8330-3ef482031ebb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:58.565224 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-d0c68774-e677-4f22-8330-3ef482031ebb tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1739 microversion: 2.20 time: 0.183633 May 12 11:50:58.566079 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 385/766] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:58 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:50:58.770440 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-918f89ae-2449-4164-9300-1cd91234b338 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:58.772324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-918f89ae-2449-4164-9300-1cd91234b338 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:58.779423 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-918f89ae-2449-4164-9300-1cd91234b338 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:58.780198 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-918f89ae-2449-4164-9300-1cd91234b338 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:58.781382 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-918f89ae-2449-4164-9300-1cd91234b338 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:58.782170 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-918f89ae-2449-4164-9300-1cd91234b338 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:58.958796 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-918f89ae-2449-4164-9300-1cd91234b338 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:58.968893 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-918f89ae-2449-4164-9300-1cd91234b338 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 200 len: 1363 microversion: 2.1 time: 0.199966 May 12 11:50:58.971643 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 382/767] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:58 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:50:59.585857 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-544f3213-8126-4d8a-a4e9-494efed949a9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:59.588191 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-544f3213-8126-4d8a-a4e9-494efed949a9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:50:59.600447 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-544f3213-8126-4d8a-a4e9-494efed949a9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:59.600906 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-544f3213-8126-4d8a-a4e9-494efed949a9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:59.601715 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-544f3213-8126-4d8a-a4e9-494efed949a9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:50:59.602155 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-544f3213-8126-4d8a-a4e9-494efed949a9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:50:59.744293 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-544f3213-8126-4d8a-a4e9-494efed949a9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:59.753552 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-544f3213-8126-4d8a-a4e9-494efed949a9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:59.755387 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-544f3213-8126-4d8a-a4e9-494efed949a9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:50:59.756754 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-544f3213-8126-4d8a-a4e9-494efed949a9 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1739 microversion: 2.20 time: 0.175396 May 12 11:50:59.767410 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 386/768] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:50:59 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:50:59.988973 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-75a1f77d-ea0e-4837-9e74-be15fc874eb3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:50:59.990542 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-75a1f77d-ea0e-4837-9e74-be15fc874eb3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:00.012908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-75a1f77d-ea0e-4837-9e74-be15fc874eb3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:00.013667 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-75a1f77d-ea0e-4837-9e74-be15fc874eb3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:00.014638 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-75a1f77d-ea0e-4837-9e74-be15fc874eb3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:00.016390 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-75a1f77d-ea0e-4837-9e74-be15fc874eb3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:00.204655 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-75a1f77d-ea0e-4837-9e74-be15fc874eb3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:00.215825 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-75a1f77d-ea0e-4837-9e74-be15fc874eb3 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 200 len: 1550 microversion: 2.1 time: 0.231791 May 12 11:51:00.217423 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 383/769] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:50:59 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 1550 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:51:00.236212 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-18ed1a61-3eeb-4556-b84a-dd305b8c4bc0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:00.237273 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-18ed1a61-3eeb-4556-b84a-dd305b8c4bc0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:00.244110 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-18ed1a61-3eeb-4556-b84a-dd305b8c4bc0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:00.245074 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-18ed1a61-3eeb-4556-b84a-dd305b8c4bc0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:00.245912 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-18ed1a61-3eeb-4556-b84a-dd305b8c4bc0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:00.246360 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-18ed1a61-3eeb-4556-b84a-dd305b8c4bc0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:00.341028 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-18ed1a61-3eeb-4556-b84a-dd305b8c4bc0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111839 May 12 11:51:00.342177 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 387/770] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 12 11:51:00 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:51:00.774634 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-1468df3a-df67-4d4b-bda6-d7ea1d1e4325 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:00.775281 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-1468df3a-df67-4d4b-bda6-d7ea1d1e4325 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:00.781810 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1468df3a-df67-4d4b-bda6-d7ea1d1e4325 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:00.782343 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1468df3a-df67-4d4b-bda6-d7ea1d1e4325 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:00.783896 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1468df3a-df67-4d4b-bda6-d7ea1d1e4325 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:00.784410 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1468df3a-df67-4d4b-bda6-d7ea1d1e4325 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:01.009205 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-1468df3a-df67-4d4b-bda6-d7ea1d1e4325 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:01.022906 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-1468df3a-df67-4d4b-bda6-d7ea1d1e4325 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:01.022906 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-1468df3a-df67-4d4b-bda6-d7ea1d1e4325 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:01.024439 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-1468df3a-df67-4d4b-bda6-d7ea1d1e4325 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1739 microversion: 2.20 time: 0.253385 May 12 11:51:01.025519 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 384/771] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:00 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:51:01.936420 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-8a67c8af-f260-4afb-8984-9f8ed5b18958 req-179775cb-4e1c-4b5f-80d9-f39b4ce35ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53e646cc-6d91-43a7-bcf8-3b2b90228e12", "tag": "00d7eab1-f59b-4a04-84f7-bd2c41023215"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:51:01.944342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-8a67c8af-f260-4afb-8984-9f8ed5b18958 req-179775cb-4e1c-4b5f-80d9-f39b4ce35ac6 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:01.944788 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-8a67c8af-f260-4afb-8984-9f8ed5b18958 req-179775cb-4e1c-4b5f-80d9-f39b4ce35ac6 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:01.956380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-8a67c8af-f260-4afb-8984-9f8ed5b18958 req-179775cb-4e1c-4b5f-80d9-f39b4ce35ac6 service nova] Creating event network-changed:00d7eab1-f59b-4a04-84f7-bd2c41023215 for instance 53e646cc-6d91-43a7-bcf8-3b2b90228e12 on hv-cinder-80473 May 12 11:51:01.961607 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-8a67c8af-f260-4afb-8984-9f8ed5b18958 req-179775cb-4e1c-4b5f-80d9-f39b4ce35ac6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087299 May 12 11:51:01.962298 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 388/772] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:51:02.051156 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-54c6c5ed-ef0d-4056-a252-51f66d9b9dbd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:02.051877 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-54c6c5ed-ef0d-4056-a252-51f66d9b9dbd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:02.058997 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-54c6c5ed-ef0d-4056-a252-51f66d9b9dbd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:02.059447 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-54c6c5ed-ef0d-4056-a252-51f66d9b9dbd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:02.060435 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-54c6c5ed-ef0d-4056-a252-51f66d9b9dbd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:02.061727 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-54c6c5ed-ef0d-4056-a252-51f66d9b9dbd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:02.190535 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-54c6c5ed-ef0d-4056-a252-51f66d9b9dbd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:02.198407 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-54c6c5ed-ef0d-4056-a252-51f66d9b9dbd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:02.200373 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-54c6c5ed-ef0d-4056-a252-51f66d9b9dbd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:02.201540 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-54c6c5ed-ef0d-4056-a252-51f66d9b9dbd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1739 microversion: 2.20 time: 0.154480 May 12 11:51:02.202184 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 385/773] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:02 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:51:03.221778 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-f622c313-c8d1-4603-a3c4-0c1239267a10 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:03.222511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-f622c313-c8d1-4603-a3c4-0c1239267a10 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:03.228558 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f622c313-c8d1-4603-a3c4-0c1239267a10 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:03.229007 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f622c313-c8d1-4603-a3c4-0c1239267a10 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:03.229804 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f622c313-c8d1-4603-a3c4-0c1239267a10 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:03.230242 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f622c313-c8d1-4603-a3c4-0c1239267a10 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:03.383726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-f622c313-c8d1-4603-a3c4-0c1239267a10 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:03.391598 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-f622c313-c8d1-4603-a3c4-0c1239267a10 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:03.393147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-f622c313-c8d1-4603-a3c4-0c1239267a10 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:03.394354 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-f622c313-c8d1-4603-a3c4-0c1239267a10 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1721 microversion: 2.20 time: 0.177842 May 12 11:51:03.405142 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 389/774] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:03 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:51:04.412367 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-719b2181-887a-4982-b838-5c28017401aa tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:04.413015 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-719b2181-887a-4982-b838-5c28017401aa tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:04.419663 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-719b2181-887a-4982-b838-5c28017401aa tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:04.420119 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-719b2181-887a-4982-b838-5c28017401aa tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:04.420899 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-719b2181-887a-4982-b838-5c28017401aa tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:04.421339 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-719b2181-887a-4982-b838-5c28017401aa tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:04.557980 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-719b2181-887a-4982-b838-5c28017401aa tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:04.574249 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-719b2181-887a-4982-b838-5c28017401aa tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:04.574249 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-719b2181-887a-4982-b838-5c28017401aa tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:04.574249 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-719b2181-887a-4982-b838-5c28017401aa tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1721 microversion: 2.20 time: 0.161470 May 12 11:51:04.574586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 386/775] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:04 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:51:05.587250 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-e1518e23-2e68-4d89-aa5a-d04f9a4f37ac tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:05.587866 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-e1518e23-2e68-4d89-aa5a-d04f9a4f37ac tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:05.594133 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e1518e23-2e68-4d89-aa5a-d04f9a4f37ac tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:05.594583 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e1518e23-2e68-4d89-aa5a-d04f9a4f37ac tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:05.595352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e1518e23-2e68-4d89-aa5a-d04f9a4f37ac tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:05.596286 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e1518e23-2e68-4d89-aa5a-d04f9a4f37ac tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:05.728137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-e1518e23-2e68-4d89-aa5a-d04f9a4f37ac tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:05.735764 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-e1518e23-2e68-4d89-aa5a-d04f9a4f37ac tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:05.737300 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-e1518e23-2e68-4d89-aa5a-d04f9a4f37ac tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:05.738488 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-e1518e23-2e68-4d89-aa5a-d04f9a4f37ac tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1664 microversion: 2.20 time: 0.155178 May 12 11:51:05.739063 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 390/776] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:05 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:51:05.755711 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-98c5ca66-072a-4813-b0bf-f953177fdfd2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30ee379f-ac8d-4785-a0e2-71ef1371143e"}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:51:05.756802 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-98c5ca66-072a-4813-b0bf-f953177fdfd2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:05.762791 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-98c5ca66-072a-4813-b0bf-f953177fdfd2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:05.763239 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-98c5ca66-072a-4813-b0bf-f953177fdfd2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:05.764007 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-98c5ca66-072a-4813-b0bf-f953177fdfd2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:05.764440 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-98c5ca66-072a-4813-b0bf-f953177fdfd2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:06.041574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-98c5ca66-072a-4813-b0bf-f953177fdfd2 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "POST /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.289659 May 12 11:51:06.042208 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 387/777] 10.222.0.58 () {62 vars in 1363 bytes} [Thu May 12 11:51:05 2022] POST /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab/os-volume_attachments => generated 188 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 11:51:06.163058 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-e5abde2f-19a0-45ac-9820-776c185f3ce3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:06.163561 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-e5abde2f-19a0-45ac-9820-776c185f3ce3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:06.169280 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e5abde2f-19a0-45ac-9820-776c185f3ce3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:06.169831 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e5abde2f-19a0-45ac-9820-776c185f3ce3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:06.170604 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e5abde2f-19a0-45ac-9820-776c185f3ce3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:06.171062 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e5abde2f-19a0-45ac-9820-776c185f3ce3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:06.439706 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-e5abde2f-19a0-45ac-9820-776c185f3ce3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "DELETE /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab/os-volume_attachments/30ee379f-ac8d-4785-a0e2-71ef1371143e" status: 202 len: 0 microversion: 2.20 time: 0.280707 May 12 11:51:06.440435 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 391/778] 10.222.0.58 () {60 vars in 1456 bytes} [Thu May 12 11:51:06 2022] DELETE /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab/os-volume_attachments/30ee379f-ac8d-4785-a0e2-71ef1371143e => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 11:51:06.498500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-342ac483-d094-434f-bfe3-f655cb60123d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:51:06.499064 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-342ac483-d094-434f-bfe3-f655cb60123d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:06.505000 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-342ac483-d094-434f-bfe3-f655cb60123d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:06.505458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-342ac483-d094-434f-bfe3-f655cb60123d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:06.506260 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-342ac483-d094-434f-bfe3-f655cb60123d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:06.506696 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-342ac483-d094-434f-bfe3-f655cb60123d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:06.576025 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-5364de1a-a244-40d1-a35f-ce702ba399fb req-5db328c1-9499-4c4b-ad4e-965f2398ce48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efbc8e04-31bd-4238-8c9a-096ad87a46ab", "name": "network-vif-unplugged", "status": "completed", "tag": "e62c63ee-3f94-4556-b00c-c45c7465fd0e"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:51:06.604091 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-5364de1a-a244-40d1-a35f-ce702ba399fb req-5db328c1-9499-4c4b-ad4e-965f2398ce48 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:06.604828 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-5364de1a-a244-40d1-a35f-ce702ba399fb req-5db328c1-9499-4c4b-ad4e-965f2398ce48 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:06.618273 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.compute.server_external_events [req-5364de1a-a244-40d1-a35f-ce702ba399fb req-5db328c1-9499-4c4b-ad4e-965f2398ce48 service nova] Unable to find a host for instance efbc8e04-31bd-4238-8c9a-096ad87a46ab. Dropping event network-vif-unplugged {{(pid=123508) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 12 11:51:06.619342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-5364de1a-a244-40d1-a35f-ce702ba399fb req-5db328c1-9499-4c4b-ad4e-965f2398ce48 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.048743 May 12 11:51:06.620373 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 392/779] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 50 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 12 11:51:06.621323 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-342ac483-d094-434f-bfe3-f655cb60123d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "POST /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab/action" status: 202 len: 0 microversion: 2.20 time: 0.126588 May 12 11:51:06.621976 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 388/780] 10.222.0.58 () {62 vars in 1318 bytes} [Thu May 12 11:51:06 2022] POST /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 11:51:06.630378 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-dbe5ab98-bbc3-41dc-b6ae-a884502bd40c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:06.631323 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-dbe5ab98-bbc3-41dc-b6ae-a884502bd40c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:06.638608 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dbe5ab98-bbc3-41dc-b6ae-a884502bd40c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:06.639230 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dbe5ab98-bbc3-41dc-b6ae-a884502bd40c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:06.640110 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dbe5ab98-bbc3-41dc-b6ae-a884502bd40c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:06.640838 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dbe5ab98-bbc3-41dc-b6ae-a884502bd40c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:06.789567 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-dbe5ab98-bbc3-41dc-b6ae-a884502bd40c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:06.797649 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-dbe5ab98-bbc3-41dc-b6ae-a884502bd40c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:06.799394 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-dbe5ab98-bbc3-41dc-b6ae-a884502bd40c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:06.800683 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-dbe5ab98-bbc3-41dc-b6ae-a884502bd40c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1672 microversion: 2.20 time: 0.174458 May 12 11:51:06.801304 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 393/781] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:06 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1672 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:51:07.819433 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-6dc20945-5d8b-414c-ac80-5bf409664e5e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:07.820919 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-6dc20945-5d8b-414c-ac80-5bf409664e5e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:07.827123 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6dc20945-5d8b-414c-ac80-5bf409664e5e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:07.827571 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6dc20945-5d8b-414c-ac80-5bf409664e5e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:07.828343 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6dc20945-5d8b-414c-ac80-5bf409664e5e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:07.828776 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6dc20945-5d8b-414c-ac80-5bf409664e5e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:08.047032 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-6dc20945-5d8b-414c-ac80-5bf409664e5e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:08.056746 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-6dc20945-5d8b-414c-ac80-5bf409664e5e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:08.058574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-6dc20945-5d8b-414c-ac80-5bf409664e5e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:08.060485 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-6dc20945-5d8b-414c-ac80-5bf409664e5e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1730 microversion: 2.20 time: 0.244935 May 12 11:51:08.061323 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 389/782] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:07 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1730 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:51:09.079834 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-4bd66681-29d0-4e50-bbe8-35bd99b22ba5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:09.082008 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-4bd66681-29d0-4e50-bbe8-35bd99b22ba5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:09.089566 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4bd66681-29d0-4e50-bbe8-35bd99b22ba5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:09.090503 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4bd66681-29d0-4e50-bbe8-35bd99b22ba5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:09.091745 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4bd66681-29d0-4e50-bbe8-35bd99b22ba5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:09.092471 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4bd66681-29d0-4e50-bbe8-35bd99b22ba5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:09.278777 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-4bd66681-29d0-4e50-bbe8-35bd99b22ba5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:09.289094 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-4bd66681-29d0-4e50-bbe8-35bd99b22ba5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:09.290992 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-4bd66681-29d0-4e50-bbe8-35bd99b22ba5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:09.292348 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-4bd66681-29d0-4e50-bbe8-35bd99b22ba5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1730 microversion: 2.20 time: 0.216384 May 12 11:51:09.293066 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 394/783] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:09 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1730 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:51:10.312573 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-2696a35b-84ec-4587-baae-982cae031c7e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:10.313900 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-2696a35b-84ec-4587-baae-982cae031c7e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:10.320922 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2696a35b-84ec-4587-baae-982cae031c7e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:10.321380 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2696a35b-84ec-4587-baae-982cae031c7e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:10.322242 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2696a35b-84ec-4587-baae-982cae031c7e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:10.322712 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2696a35b-84ec-4587-baae-982cae031c7e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:10.520829 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-2696a35b-84ec-4587-baae-982cae031c7e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:10.528883 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-2696a35b-84ec-4587-baae-982cae031c7e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:10.530629 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-2696a35b-84ec-4587-baae-982cae031c7e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:10.531998 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-2696a35b-84ec-4587-baae-982cae031c7e tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1730 microversion: 2.20 time: 0.224319 May 12 11:51:10.553496 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 390/784] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:10 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1730 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:51:11.551408 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-3473d8bb-58ed-4e8c-9f20-448f98961f8a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:11.552625 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-3473d8bb-58ed-4e8c-9f20-448f98961f8a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:11.559355 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3473d8bb-58ed-4e8c-9f20-448f98961f8a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:11.560040 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3473d8bb-58ed-4e8c-9f20-448f98961f8a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:11.560986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3473d8bb-58ed-4e8c-9f20-448f98961f8a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:11.561674 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3473d8bb-58ed-4e8c-9f20-448f98961f8a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:11.716096 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-3473d8bb-58ed-4e8c-9f20-448f98961f8a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:11.726532 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-3473d8bb-58ed-4e8c-9f20-448f98961f8a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:11.728595 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-3473d8bb-58ed-4e8c-9f20-448f98961f8a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:11.729973 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-3473d8bb-58ed-4e8c-9f20-448f98961f8a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1730 microversion: 2.20 time: 0.183175 May 12 11:51:11.731156 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 395/785] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:11 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:51:12.748316 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-1ce305f4-4797-4550-bb26-0863413dad69 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:12.748987 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-1ce305f4-4797-4550-bb26-0863413dad69 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:12.756174 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1ce305f4-4797-4550-bb26-0863413dad69 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:12.756913 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1ce305f4-4797-4550-bb26-0863413dad69 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:12.757916 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1ce305f4-4797-4550-bb26-0863413dad69 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:12.758545 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1ce305f4-4797-4550-bb26-0863413dad69 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:12.896046 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-1ce305f4-4797-4550-bb26-0863413dad69 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:12.904115 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-1ce305f4-4797-4550-bb26-0863413dad69 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:12.905878 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-1ce305f4-4797-4550-bb26-0863413dad69 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:12.907118 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-1ce305f4-4797-4550-bb26-0863413dad69 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1730 microversion: 2.20 time: 0.162893 May 12 11:51:12.907920 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 391/786] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:12 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:51:13.925760 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-63368d3e-3fe0-4cf1-8dcb-17d7935332ed tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:13.926339 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-63368d3e-3fe0-4cf1-8dcb-17d7935332ed tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:13.933875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-63368d3e-3fe0-4cf1-8dcb-17d7935332ed tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:13.934329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-63368d3e-3fe0-4cf1-8dcb-17d7935332ed tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:13.935231 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-63368d3e-3fe0-4cf1-8dcb-17d7935332ed tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:13.935671 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-63368d3e-3fe0-4cf1-8dcb-17d7935332ed tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:14.071731 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-63368d3e-3fe0-4cf1-8dcb-17d7935332ed tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:14.081838 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-63368d3e-3fe0-4cf1-8dcb-17d7935332ed tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:14.083469 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-63368d3e-3fe0-4cf1-8dcb-17d7935332ed tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:14.084907 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-63368d3e-3fe0-4cf1-8dcb-17d7935332ed tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1730 microversion: 2.20 time: 0.163673 May 12 11:51:14.085572 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 396/787] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:13 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:51:15.104317 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-444651c0-afc5-492f-b9f8-9409d8f0fd11 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:15.104929 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-444651c0-afc5-492f-b9f8-9409d8f0fd11 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:15.111611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-444651c0-afc5-492f-b9f8-9409d8f0fd11 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:15.112070 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-444651c0-afc5-492f-b9f8-9409d8f0fd11 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:15.112872 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-444651c0-afc5-492f-b9f8-9409d8f0fd11 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:15.113652 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-444651c0-afc5-492f-b9f8-9409d8f0fd11 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:15.245280 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-444651c0-afc5-492f-b9f8-9409d8f0fd11 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:15.253893 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-444651c0-afc5-492f-b9f8-9409d8f0fd11 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:15.255397 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-444651c0-afc5-492f-b9f8-9409d8f0fd11 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:15.256569 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-444651c0-afc5-492f-b9f8-9409d8f0fd11 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1730 microversion: 2.20 time: 0.156104 May 12 11:51:15.257128 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 392/788] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:15 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:51:16.274660 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b791f84e-262b-4856-9d94-6860ef35ae26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:16.275954 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-b791f84e-262b-4856-9d94-6860ef35ae26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:16.283059 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b791f84e-262b-4856-9d94-6860ef35ae26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:16.284139 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b791f84e-262b-4856-9d94-6860ef35ae26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:16.284931 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b791f84e-262b-4856-9d94-6860ef35ae26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:16.285487 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b791f84e-262b-4856-9d94-6860ef35ae26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:16.464719 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b791f84e-262b-4856-9d94-6860ef35ae26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:16.474526 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b791f84e-262b-4856-9d94-6860ef35ae26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:16.476191 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b791f84e-262b-4856-9d94-6860ef35ae26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:16.477820 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-b791f84e-262b-4856-9d94-6860ef35ae26 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1730 microversion: 2.20 time: 0.206919 May 12 11:51:16.478876 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 397/789] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:16 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:51:17.496025 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-6a51870c-f19a-471c-9268-9b0b09dd409b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:17.496621 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-6a51870c-f19a-471c-9268-9b0b09dd409b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:17.502992 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6a51870c-f19a-471c-9268-9b0b09dd409b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:17.503891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6a51870c-f19a-471c-9268-9b0b09dd409b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:17.504193 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6a51870c-f19a-471c-9268-9b0b09dd409b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:17.504631 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6a51870c-f19a-471c-9268-9b0b09dd409b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:17.642134 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-6a51870c-f19a-471c-9268-9b0b09dd409b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:17.650092 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-6a51870c-f19a-471c-9268-9b0b09dd409b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:17.651522 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-6a51870c-f19a-471c-9268-9b0b09dd409b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:17.652676 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-6a51870c-f19a-471c-9268-9b0b09dd409b tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1730 microversion: 2.20 time: 0.160496 May 12 11:51:17.653233 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 393/790] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:17 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:51:18.671178 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-fa7aa3ae-372b-4761-b2ed-b1895235fe0c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:18.671703 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-fa7aa3ae-372b-4761-b2ed-b1895235fe0c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:18.678036 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fa7aa3ae-372b-4761-b2ed-b1895235fe0c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:18.678491 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fa7aa3ae-372b-4761-b2ed-b1895235fe0c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:18.679250 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fa7aa3ae-372b-4761-b2ed-b1895235fe0c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:18.679685 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fa7aa3ae-372b-4761-b2ed-b1895235fe0c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:18.803856 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-fa7aa3ae-372b-4761-b2ed-b1895235fe0c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:18.811473 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-fa7aa3ae-372b-4761-b2ed-b1895235fe0c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:18.812962 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-fa7aa3ae-372b-4761-b2ed-b1895235fe0c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:18.814159 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-fa7aa3ae-372b-4761-b2ed-b1895235fe0c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1730 microversion: 2.20 time: 0.146966 May 12 11:51:18.815236 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 398/791] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:18 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:51:19.832661 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-d4e03303-4a93-4f72-8317-5e72a39cdb8a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:19.833264 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d4e03303-4a93-4f72-8317-5e72a39cdb8a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:19.839565 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d4e03303-4a93-4f72-8317-5e72a39cdb8a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:19.840019 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d4e03303-4a93-4f72-8317-5e72a39cdb8a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:19.840779 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d4e03303-4a93-4f72-8317-5e72a39cdb8a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:19.841222 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d4e03303-4a93-4f72-8317-5e72a39cdb8a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:19.965331 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-d4e03303-4a93-4f72-8317-5e72a39cdb8a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:19.973763 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-d4e03303-4a93-4f72-8317-5e72a39cdb8a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:19.975446 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-d4e03303-4a93-4f72-8317-5e72a39cdb8a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:19.976661 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-d4e03303-4a93-4f72-8317-5e72a39cdb8a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1730 microversion: 2.20 time: 0.148094 May 12 11:51:19.977214 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 394/792] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:19 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:51:20.994605 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-22220cbb-8103-42ac-b1ca-a17b2ea2609f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:20.995268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-22220cbb-8103-42ac-b1ca-a17b2ea2609f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:21.001052 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-22220cbb-8103-42ac-b1ca-a17b2ea2609f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:21.001504 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-22220cbb-8103-42ac-b1ca-a17b2ea2609f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:21.002310 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-22220cbb-8103-42ac-b1ca-a17b2ea2609f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:21.002750 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-22220cbb-8103-42ac-b1ca-a17b2ea2609f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:21.130622 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-22220cbb-8103-42ac-b1ca-a17b2ea2609f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:21.138363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-22220cbb-8103-42ac-b1ca-a17b2ea2609f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:21.139861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-22220cbb-8103-42ac-b1ca-a17b2ea2609f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:21.141011 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-22220cbb-8103-42ac-b1ca-a17b2ea2609f tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1730 microversion: 2.20 time: 0.150465 May 12 11:51:21.141562 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 399/793] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:20 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 11:51:22.159368 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-43517d6e-4210-4c26-bd74-26f0a0631041 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:22.159936 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-43517d6e-4210-4c26-bd74-26f0a0631041 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:22.166171 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-43517d6e-4210-4c26-bd74-26f0a0631041 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:22.166621 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-43517d6e-4210-4c26-bd74-26f0a0631041 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:22.167388 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-43517d6e-4210-4c26-bd74-26f0a0631041 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:22.167824 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-43517d6e-4210-4c26-bd74-26f0a0631041 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:22.293922 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-43517d6e-4210-4c26-bd74-26f0a0631041 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:22.301537 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-43517d6e-4210-4c26-bd74-26f0a0631041 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:22.303701 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-43517d6e-4210-4c26-bd74-26f0a0631041 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:22.304849 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-43517d6e-4210-4c26-bd74-26f0a0631041 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1730 microversion: 2.20 time: 0.149393 May 12 11:51:22.305558 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 395/794] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:22 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:51:23.323216 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-109d2e6c-5e62-4e54-8fc9-6905df45cfa8 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:23.323821 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-109d2e6c-5e62-4e54-8fc9-6905df45cfa8 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:23.330130 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-109d2e6c-5e62-4e54-8fc9-6905df45cfa8 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:23.330583 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-109d2e6c-5e62-4e54-8fc9-6905df45cfa8 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:23.331611 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-109d2e6c-5e62-4e54-8fc9-6905df45cfa8 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:23.332048 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-109d2e6c-5e62-4e54-8fc9-6905df45cfa8 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:23.461555 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-109d2e6c-5e62-4e54-8fc9-6905df45cfa8 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:23.469254 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-109d2e6c-5e62-4e54-8fc9-6905df45cfa8 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:23.470778 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-109d2e6c-5e62-4e54-8fc9-6905df45cfa8 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:23.471925 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-109d2e6c-5e62-4e54-8fc9-6905df45cfa8 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1730 microversion: 2.20 time: 0.152543 May 12 11:51:23.472483 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 400/795] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:23 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:51:24.489588 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-693d93f5-1040-4f01-9893-d5d356180824 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:24.490284 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-693d93f5-1040-4f01-9893-d5d356180824 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:24.496675 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-693d93f5-1040-4f01-9893-d5d356180824 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:24.497109 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-693d93f5-1040-4f01-9893-d5d356180824 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:24.497902 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-693d93f5-1040-4f01-9893-d5d356180824 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:24.498343 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-693d93f5-1040-4f01-9893-d5d356180824 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:24.621982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-693d93f5-1040-4f01-9893-d5d356180824 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:24.629532 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-693d93f5-1040-4f01-9893-d5d356180824 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:24.631073 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-693d93f5-1040-4f01-9893-d5d356180824 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:24.632228 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-693d93f5-1040-4f01-9893-d5d356180824 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1730 microversion: 2.20 time: 0.146509 May 12 11:51:24.632777 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 396/796] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:24 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:51:25.649773 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-c6e87857-efae-4776-886c-348cc0bd71f0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:25.650391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-c6e87857-efae-4776-886c-348cc0bd71f0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:25.656758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c6e87857-efae-4776-886c-348cc0bd71f0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:25.657205 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c6e87857-efae-4776-886c-348cc0bd71f0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:25.658012 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c6e87857-efae-4776-886c-348cc0bd71f0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:25.658459 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c6e87857-efae-4776-886c-348cc0bd71f0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:25.787847 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c6e87857-efae-4776-886c-348cc0bd71f0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:25.795573 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c6e87857-efae-4776-886c-348cc0bd71f0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:25.797069 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c6e87857-efae-4776-886c-348cc0bd71f0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:25.798287 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-c6e87857-efae-4776-886c-348cc0bd71f0 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1730 microversion: 2.20 time: 0.153006 May 12 11:51:25.798854 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 401/797] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:25 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:51:26.255905 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-1245ee43-e16c-455f-b0e4-4e8934205e26 req-22e732a8-1d60-4665-b0a3-8edc137d6a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efbc8e04-31bd-4238-8c9a-096ad87a46ab", "name": "network-vif-plugged", "status": "completed", "tag": "e62c63ee-3f94-4556-b00c-c45c7465fd0e"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:51:26.266964 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-1245ee43-e16c-455f-b0e4-4e8934205e26 req-22e732a8-1d60-4665-b0a3-8edc137d6a15 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:26.267299 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-1245ee43-e16c-455f-b0e4-4e8934205e26 req-22e732a8-1d60-4665-b0a3-8edc137d6a15 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:26.279065 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-1245ee43-e16c-455f-b0e4-4e8934205e26 req-22e732a8-1d60-4665-b0a3-8edc137d6a15 service nova] Creating event network-vif-plugged:e62c63ee-3f94-4556-b00c-c45c7465fd0e for instance efbc8e04-31bd-4238-8c9a-096ad87a46ab on hv-cinder-80473 May 12 11:51:26.284537 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-1245ee43-e16c-455f-b0e4-4e8934205e26 req-22e732a8-1d60-4665-b0a3-8edc137d6a15 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032889 May 12 11:51:26.285652 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 397/798] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:51:26.816134 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ea1d60e4-5d0e-49b6-a535-6737aea63049 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:26.816744 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-ea1d60e4-5d0e-49b6-a535-6737aea63049 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:26.823047 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ea1d60e4-5d0e-49b6-a535-6737aea63049 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:26.823515 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ea1d60e4-5d0e-49b6-a535-6737aea63049 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:26.824333 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ea1d60e4-5d0e-49b6-a535-6737aea63049 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:26.824774 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ea1d60e4-5d0e-49b6-a535-6737aea63049 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:26.953966 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-ea1d60e4-5d0e-49b6-a535-6737aea63049 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:26.962438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-ea1d60e4-5d0e-49b6-a535-6737aea63049 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:26.963983 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-ea1d60e4-5d0e-49b6-a535-6737aea63049 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:26.965132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-ea1d60e4-5d0e-49b6-a535-6737aea63049 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1730 microversion: 2.20 time: 0.152925 May 12 11:51:26.965688 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 402/799] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:26 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:51:27.983863 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-680a9462-0041-45a5-98fc-8259e67ee3d1 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:27.984584 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-680a9462-0041-45a5-98fc-8259e67ee3d1 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:27.991609 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-680a9462-0041-45a5-98fc-8259e67ee3d1 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:27.992055 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-680a9462-0041-45a5-98fc-8259e67ee3d1 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:27.992822 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-680a9462-0041-45a5-98fc-8259e67ee3d1 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:27.993256 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-680a9462-0041-45a5-98fc-8259e67ee3d1 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:28.127133 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-680a9462-0041-45a5-98fc-8259e67ee3d1 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:28.134850 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-680a9462-0041-45a5-98fc-8259e67ee3d1 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:28.136334 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-680a9462-0041-45a5-98fc-8259e67ee3d1 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:28.137472 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-680a9462-0041-45a5-98fc-8259e67ee3d1 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1730 microversion: 2.20 time: 0.157872 May 12 11:51:28.138058 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 398/800] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:27 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:51:29.157241 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-840f2a39-13d9-4471-b7ba-105033024d22 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:29.158063 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-840f2a39-13d9-4471-b7ba-105033024d22 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:29.164659 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-840f2a39-13d9-4471-b7ba-105033024d22 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:29.165184 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-840f2a39-13d9-4471-b7ba-105033024d22 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:29.165917 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-840f2a39-13d9-4471-b7ba-105033024d22 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:29.166351 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-840f2a39-13d9-4471-b7ba-105033024d22 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:29.299120 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-840f2a39-13d9-4471-b7ba-105033024d22 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:29.307986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-840f2a39-13d9-4471-b7ba-105033024d22 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:29.309489 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-840f2a39-13d9-4471-b7ba-105033024d22 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:51:29.310659 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-840f2a39-13d9-4471-b7ba-105033024d22 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1717 microversion: 2.20 time: 0.157687 May 12 11:51:29.311217 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 403/801] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:51:29 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1717 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:51:41.196991 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-c1363c23-e32f-44da-8c44-e8688ac13dcc tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:41.197468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-c1363c23-e32f-44da-8c44-e8688ac13dcc tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:41.203308 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c1363c23-e32f-44da-8c44-e8688ac13dcc tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:41.203747 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c1363c23-e32f-44da-8c44-e8688ac13dcc tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:41.204510 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c1363c23-e32f-44da-8c44-e8688ac13dcc tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:41.205024 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c1363c23-e32f-44da-8c44-e8688ac13dcc tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:41.228076 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-c1363c23-e32f-44da-8c44-e8688ac13dcc tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/ips" status: 200 len: 146 microversion: 2.1 time: 0.191030 May 12 11:51:41.228640 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 399/802] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 12 11:51:41 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/ips => generated 146 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:51:42.529928 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-d97ee42c-8712-4c58-9233-faf858e9e014 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea26913c-92d2-4434-a7bc-6cbf6f3f0aa1"}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:51:42.530985 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d97ee42c-8712-4c58-9233-faf858e9e014 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:42.537439 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d97ee42c-8712-4c58-9233-faf858e9e014 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:42.538550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d97ee42c-8712-4c58-9233-faf858e9e014 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:42.539301 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d97ee42c-8712-4c58-9233-faf858e9e014 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:42.539738 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d97ee42c-8712-4c58-9233-faf858e9e014 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:42.805081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-d97ee42c-8712-4c58-9233-faf858e9e014 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "POST /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278896 May 12 11:51:42.805721 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 404/803] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 12 11:51:42 2022] POST /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:51:50.278540 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-474c06a3-392c-4a3a-9963-a633e31f64c9 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:50.279496 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-474c06a3-392c-4a3a-9963-a633e31f64c9 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:50.286186 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-474c06a3-392c-4a3a-9963-a633e31f64c9 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:50.286634 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-474c06a3-392c-4a3a-9963-a633e31f64c9 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:50.287410 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-474c06a3-392c-4a3a-9963-a633e31f64c9 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:50.287847 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-474c06a3-392c-4a3a-9963-a633e31f64c9 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:50.319055 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-474c06a3-392c-4a3a-9963-a633e31f64c9 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044344 May 12 11:51:50.320148 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 400/804] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 12 11:51:50 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:51:50.331036 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-3e93573b-a9ba-4758-814f-e69d53488da0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:50.331628 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-3e93573b-a9ba-4758-814f-e69d53488da0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:50.338905 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3e93573b-a9ba-4758-814f-e69d53488da0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:50.339363 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3e93573b-a9ba-4758-814f-e69d53488da0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:50.340132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3e93573b-a9ba-4758-814f-e69d53488da0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:50.340571 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3e93573b-a9ba-4758-814f-e69d53488da0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:50.368641 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-3e93573b-a9ba-4758-814f-e69d53488da0 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-volume_attachments/ea26913c-92d2-4434-a7bc-6cbf6f3f0aa1" status: 200 len: 194 microversion: 2.1 time: 0.042305 May 12 11:51:50.369241 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 405/805] 10.222.0.58 () {58 vars in 1412 bytes} [Thu May 12 11:51:50 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-volume_attachments/ea26913c-92d2-4434-a7bc-6cbf6f3f0aa1 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:51:51.687570 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-1f50f7cb-6d79-46dc-8779-fb092d29f7af tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aaabdb3c-14b1-4b15-8bda-e6ce8659dddb"}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:51:51.688923 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-1f50f7cb-6d79-46dc-8779-fb092d29f7af tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:51.696243 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1f50f7cb-6d79-46dc-8779-fb092d29f7af tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:51.696688 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1f50f7cb-6d79-46dc-8779-fb092d29f7af tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:51.697450 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1f50f7cb-6d79-46dc-8779-fb092d29f7af tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:51.697906 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1f50f7cb-6d79-46dc-8779-fb092d29f7af tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:51.952859 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-1f50f7cb-6d79-46dc-8779-fb092d29f7af tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "POST /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270102 May 12 11:51:51.953897 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 401/806] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 12 11:51:51 2022] POST /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:51:59.437308 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-c1b7db6a-3ae4-4087-8f1e-a0833e0759cb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:59.438310 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-c1b7db6a-3ae4-4087-8f1e-a0833e0759cb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:59.444505 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c1b7db6a-3ae4-4087-8f1e-a0833e0759cb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:59.444951 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c1b7db6a-3ae4-4087-8f1e-a0833e0759cb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:59.445727 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c1b7db6a-3ae4-4087-8f1e-a0833e0759cb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:59.446157 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c1b7db6a-3ae4-4087-8f1e-a0833e0759cb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:59.475111 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-c1b7db6a-3ae4-4087-8f1e-a0833e0759cb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041595 May 12 11:51:59.475664 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 406/807] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 12 11:51:59 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:51:59.629603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-2b46df16-ddf2-416c-b623-8924e3bcb89f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:59.630254 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-2b46df16-ddf2-416c-b623-8924e3bcb89f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:59.636435 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2b46df16-ddf2-416c-b623-8924e3bcb89f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:59.636910 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2b46df16-ddf2-416c-b623-8924e3bcb89f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:59.637670 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2b46df16-ddf2-416c-b623-8924e3bcb89f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:59.638142 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2b46df16-ddf2-416c-b623-8924e3bcb89f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:59.665101 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-2b46df16-ddf2-416c-b623-8924e3bcb89f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-volume_attachments/ea26913c-92d2-4434-a7bc-6cbf6f3f0aa1" status: 200 len: 194 microversion: 2.1 time: 0.040273 May 12 11:51:59.666207 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 402/808] 10.222.0.58 () {58 vars in 1412 bytes} [Thu May 12 11:51:59 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-volume_attachments/ea26913c-92d2-4434-a7bc-6cbf6f3f0aa1 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:51:59.675717 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-daee12db-a296-4606-8be8-586fe103dc04 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:51:59.676156 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-daee12db-a296-4606-8be8-586fe103dc04 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:51:59.682694 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-daee12db-a296-4606-8be8-586fe103dc04 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:59.683149 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-daee12db-a296-4606-8be8-586fe103dc04 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:59.683920 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-daee12db-a296-4606-8be8-586fe103dc04 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:51:59.684361 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-daee12db-a296-4606-8be8-586fe103dc04 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:51:59.761010 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.objects.instance [None req-daee12db-a296-4606-8be8-586fe103dc04 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lazy-loading 'services' on Instance uuid 53e646cc-6d91-43a7-bcf8-3b2b90228e12 {{(pid=123508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:51:59.828394 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-daee12db-a296-4606-8be8-586fe103dc04 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "DELETE /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-volume_attachments/ea26913c-92d2-4434-a7bc-6cbf6f3f0aa1" status: 202 len: 0 microversion: 2.1 time: 0.156478 May 12 11:51:59.829060 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 407/809] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 12 11:51:59 2022] DELETE /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-volume_attachments/ea26913c-92d2-4434-a7bc-6cbf6f3f0aa1 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:52:01.993616 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-9a804461-8167-4d0b-bc7c-fec76e274fcf tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:01.994151 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-9a804461-8167-4d0b-bc7c-fec76e274fcf tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:02.000360 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9a804461-8167-4d0b-bc7c-fec76e274fcf tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:02.000810 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9a804461-8167-4d0b-bc7c-fec76e274fcf tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:02.001574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9a804461-8167-4d0b-bc7c-fec76e274fcf tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:02.002038 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9a804461-8167-4d0b-bc7c-fec76e274fcf tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:02.030593 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-9a804461-8167-4d0b-bc7c-fec76e274fcf tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-volume_attachments/aaabdb3c-14b1-4b15-8bda-e6ce8659dddb" status: 200 len: 194 microversion: 2.1 time: 0.040817 May 12 11:52:02.031168 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 403/810] 10.222.0.58 () {58 vars in 1412 bytes} [Thu May 12 11:52:01 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-volume_attachments/aaabdb3c-14b1-4b15-8bda-e6ce8659dddb => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:52:02.041893 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-c95c159e-f52c-4d93-b98c-dee640338dca tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:02.042483 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-c95c159e-f52c-4d93-b98c-dee640338dca tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:02.048561 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c95c159e-f52c-4d93-b98c-dee640338dca tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:02.049017 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c95c159e-f52c-4d93-b98c-dee640338dca tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:02.049823 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c95c159e-f52c-4d93-b98c-dee640338dca tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:02.050267 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c95c159e-f52c-4d93-b98c-dee640338dca tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:02.128693 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.objects.instance [None req-c95c159e-f52c-4d93-b98c-dee640338dca tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lazy-loading 'services' on Instance uuid 53e646cc-6d91-43a7-bcf8-3b2b90228e12 {{(pid=123508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:52:02.198313 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-c95c159e-f52c-4d93-b98c-dee640338dca tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "DELETE /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-volume_attachments/aaabdb3c-14b1-4b15-8bda-e6ce8659dddb" status: 202 len: 0 microversion: 2.1 time: 0.160965 May 12 11:52:02.199063 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 408/811] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 12 11:52:02 2022] DELETE /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-volume_attachments/aaabdb3c-14b1-4b15-8bda-e6ce8659dddb => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:52:03.352794 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-a34f0181-2796-46bb-b8ec-f65fe7e7335b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:03.353865 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-a34f0181-2796-46bb-b8ec-f65fe7e7335b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:03.360102 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a34f0181-2796-46bb-b8ec-f65fe7e7335b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:03.360550 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a34f0181-2796-46bb-b8ec-f65fe7e7335b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:03.361304 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a34f0181-2796-46bb-b8ec-f65fe7e7335b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:03.361754 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a34f0181-2796-46bb-b8ec-f65fe7e7335b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:03.389312 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-a34f0181-2796-46bb-b8ec-f65fe7e7335b tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040421 May 12 11:52:03.389883 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 404/812] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 12 11:52:03 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 11:52:03.492162 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-57953743-08f4-4a1e-b131-b02c96c8833c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:03.493208 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-57953743-08f4-4a1e-b131-b02c96c8833c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:03.499748 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-57953743-08f4-4a1e-b131-b02c96c8833c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:03.500241 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-57953743-08f4-4a1e-b131-b02c96c8833c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:03.501019 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-57953743-08f4-4a1e-b131-b02c96c8833c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:03.501463 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-57953743-08f4-4a1e-b131-b02c96c8833c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:03.687789 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-57953743-08f4-4a1e-b131-b02c96c8833c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.199720 May 12 11:52:03.688252 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 409/813] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 12 11:52:03 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12/os-volume_attachments => generated 25 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 11:52:03.743087 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-a16a66bc-e625-418b-8088-48273d16f01c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:03.744112 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-a16a66bc-e625-418b-8088-48273d16f01c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:03.750055 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a16a66bc-e625-418b-8088-48273d16f01c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:03.750708 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a16a66bc-e625-418b-8088-48273d16f01c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:03.751684 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a16a66bc-e625-418b-8088-48273d16f01c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:03.752135 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a16a66bc-e625-418b-8088-48273d16f01c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:03.777244 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-a16a66bc-e625-418b-8088-48273d16f01c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Going to try to terminate instance {{(pid=123507) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 11:52:03.861554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-a16a66bc-e625-418b-8088-48273d16f01c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "DELETE /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 204 len: 0 microversion: 2.1 time: 0.121986 May 12 11:52:03.862990 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 405/814] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:52:03 2022] DELETE /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 11:52:03.876259 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-f2b46e89-3f96-4c1e-afe8-34788ea9c48a tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:03.876988 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-f2b46e89-3f96-4c1e-afe8-34788ea9c48a tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:03.882913 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f2b46e89-3f96-4c1e-afe8-34788ea9c48a tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:03.883360 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f2b46e89-3f96-4c1e-afe8-34788ea9c48a tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:03.884194 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f2b46e89-3f96-4c1e-afe8-34788ea9c48a tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:03.885210 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f2b46e89-3f96-4c1e-afe8-34788ea9c48a tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:04.013085 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-f2b46e89-3f96-4c1e-afe8-34788ea9c48a tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:04.020464 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-f2b46e89-3f96-4c1e-afe8-34788ea9c48a tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 200 len: 1674 microversion: 2.1 time: 0.153134 May 12 11:52:04.021162 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 410/815] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:52:03 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:52:05.038342 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-0e13b390-b3f7-4a90-af4d-ff7864e54c8f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:05.039053 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-0e13b390-b3f7-4a90-af4d-ff7864e54c8f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:05.046189 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0e13b390-b3f7-4a90-af4d-ff7864e54c8f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:05.046643 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0e13b390-b3f7-4a90-af4d-ff7864e54c8f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:05.047405 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0e13b390-b3f7-4a90-af4d-ff7864e54c8f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:05.047848 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-0e13b390-b3f7-4a90-af4d-ff7864e54c8f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:05.174023 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-0e13b390-b3f7-4a90-af4d-ff7864e54c8f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:05.181944 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-0e13b390-b3f7-4a90-af4d-ff7864e54c8f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 200 len: 1674 microversion: 2.1 time: 0.147111 May 12 11:52:05.182519 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 406/816] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:52:05 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:52:06.200188 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-d1226fb9-5517-4c0c-92c0-6b4e71fc650f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:06.200792 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d1226fb9-5517-4c0c-92c0-6b4e71fc650f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:06.207264 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d1226fb9-5517-4c0c-92c0-6b4e71fc650f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:06.207990 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d1226fb9-5517-4c0c-92c0-6b4e71fc650f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:06.208768 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d1226fb9-5517-4c0c-92c0-6b4e71fc650f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:06.209205 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d1226fb9-5517-4c0c-92c0-6b4e71fc650f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:06.350586 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-d1226fb9-5517-4c0c-92c0-6b4e71fc650f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97227abbbafa46f1b0660e3be2ceea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51975fc708d49efa56621b0fd19c47f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:06.359246 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-d1226fb9-5517-4c0c-92c0-6b4e71fc650f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 200 len: 1674 microversion: 2.1 time: 0.163958 May 12 11:52:06.360724 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 411/817] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:52:06 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:52:06.786781 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-13b3d8e3-efc4-474b-8b4d-27410018a8d7 req-be7f0677-2000-4923-970d-8e50cfdc8da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e646cc-6d91-43a7-bcf8-3b2b90228e12", "name": "network-vif-deleted", "tag": "00d7eab1-f59b-4a04-84f7-bd2c41023215"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:52:06.818434 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-13b3d8e3-efc4-474b-8b4d-27410018a8d7 req-be7f0677-2000-4923-970d-8e50cfdc8da3 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:06.818888 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-13b3d8e3-efc4-474b-8b4d-27410018a8d7 req-be7f0677-2000-4923-970d-8e50cfdc8da3 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:06.845184 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-13b3d8e3-efc4-474b-8b4d-27410018a8d7 req-be7f0677-2000-4923-970d-8e50cfdc8da3 service nova] Creating event network-vif-deleted:00d7eab1-f59b-4a04-84f7-bd2c41023215 for instance 53e646cc-6d91-43a7-bcf8-3b2b90228e12 on hv-cinder-80473 May 12 11:52:06.856025 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-13b3d8e3-efc4-474b-8b4d-27410018a8d7 req-be7f0677-2000-4923-970d-8e50cfdc8da3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073269 May 12 11:52:06.856645 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 407/818] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:52:07.377683 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-31525964-d19a-412c-abcf-0cc1520788fb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:07.378306 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-31525964-d19a-412c-abcf-0cc1520788fb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:07.385003 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-31525964-d19a-412c-abcf-0cc1520788fb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:07.385446 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-31525964-d19a-412c-abcf-0cc1520788fb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:07.386240 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-31525964-d19a-412c-abcf-0cc1520788fb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:07.386676 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-31525964-d19a-412c-abcf-0cc1520788fb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:07.399581 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-31525964-d19a-412c-abcf-0cc1520788fb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] HTTP exception thrown: Instance 53e646cc-6d91-43a7-bcf8-3b2b90228e12 could not be found. May 12 11:52:07.401798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-31525964-d19a-412c-abcf-0cc1520788fb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Request method failure captured: May 12 11:52:07.401798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 HTTP/1.1 May 12 11:52:07.401798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:52:07.401798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:52:07.401798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:52:07.401798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:52:07.401798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:52:07.401798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:52:07.401798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:52:07.401798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:52:07.401798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPN72ankLKFrhJZR6C9M0dw-hZiyRt2TUcTdfesTpyCjr9OGMmXaA66OtYjMn8nYY67uZhB9uLgl0jwQoZVi3Y7RS0U9fP_Lye0Yg766PW_npIuypBUoIxJt9qk5Xad8asCqybumyRetKRLRv4rX8oQrT-L3kxEIm7ZFNVWac1-Kq08 May 12 11:52:07.401798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:52:07.401798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:52:07.401798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:52:07.401798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:52:07.401798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:52:07.401798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:52:07.401798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: d51975fc708d49efa56621b0fd19c47f May 12 11:52:07.401798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-AttachVolumeTestJSON-1858507414 May 12 11:52:07.401798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:52:07.401798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:52:07.403458 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d51975fc708d49efa56621b0fd19c47f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d51975fc708d49efa56621b0fd19c47f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d51975fc708d49efa56621b0fd19c47f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d51975fc708d49efa56621b0fd19c47f", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:52:07.403458 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-AttachVolumeTestJSON-1858507414 May 12 11:52:07.403458 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: d51975fc708d49efa56621b0fd19c47f May 12 11:52:07.403458 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1858507414 May 12 11:52:07.403458 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-AttachVolumeTestJSON-1858507414-project May 12 11:52:07.403458 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:52:07.403458 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:52:07.403458 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 97227abbbafa46f1b0660e3be2ceea70 May 12 11:52:07.403458 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-AttachVolumeTestJSON-1858507414-project May 12 11:52:07.403458 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:52:07.403458 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance 53e646cc-6d91-43a7-bcf8-3b2b90228e12 could not be found. May 12 11:52:07.403458 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': '53e646cc-6d91-43a7-bcf8-3b2b90228e12'} May 12 11:52:07.404315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:52:07.404315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:07.404315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:52:07.404315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:52:07.404315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:52:07.404315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:52:07.404315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:52:07.404315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:52:07.404315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:52:07.404315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:52:07.404315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53e646cc-6d91-43a7-bcf8-3b2b90228e12 could not be found. May 12 11:52:07.404315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:07.404315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:52:07.404315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:07.404315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:07.404315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:52:07.404315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:52:07.404315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:52:07.404315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:52:07.404315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:52:07.405571 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:52:07.405571 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:52:07.405571 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:52:07.405571 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:52:07.405571 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:52:07.405571 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:52:07.405571 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:52:07.405571 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53e646cc-6d91-43a7-bcf8-3b2b90228e12 could not be found. May 12 11:52:07.405571 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:07.405571 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:52:07.405571 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:07.405571 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:07.405571 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:52:07.405571 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:52:07.405571 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:52:07.405571 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:52:07.405571 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53e646cc-6d91-43a7-bcf8-3b2b90228e12 could not be found. May 12 11:52:07.405571 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:07.406728 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-31525964-d19a-412c-abcf-0cc1520788fb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Returning 404 to user: Instance 53e646cc-6d91-43a7-bcf8-3b2b90228e12 could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:52:07.406728 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-31525964-d19a-412c-abcf-0cc1520788fb tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 404 len: 111 microversion: 2.1 time: 0.029405 May 12 11:52:07.406728 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 412/819] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:52:07 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:52:07.413042 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-277f83ac-bec3-4187-8f40-c9fa1c7eea92 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '.version_select at 0x7f29f780e550>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:07.430544 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-277f83ac-bec3-4187-8f40-c9fa1c7eea92 tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1742982891" status: 202 len: 0 microversion: 2.1 time: 0.021777 May 12 11:52:07.431743 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 408/820] 10.222.0.58 () {58 vars in 1220 bytes} [Thu May 12 11:52:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1742982891 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:52:10.525831 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-e0b7252e-2dc2-45c4-9521-f12c56fbc21f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:10.526382 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-e0b7252e-2dc2-45c4-9521-f12c56fbc21f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:10.532506 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e0b7252e-2dc2-45c4-9521-f12c56fbc21f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:10.532951 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e0b7252e-2dc2-45c4-9521-f12c56fbc21f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:10.533729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e0b7252e-2dc2-45c4-9521-f12c56fbc21f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:10.534162 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e0b7252e-2dc2-45c4-9521-f12c56fbc21f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:10.547549 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-e0b7252e-2dc2-45c4-9521-f12c56fbc21f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] HTTP exception thrown: Instance 53e646cc-6d91-43a7-bcf8-3b2b90228e12 could not be found. May 12 11:52:10.549090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-e0b7252e-2dc2-45c4-9521-f12c56fbc21f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Request method failure captured: May 12 11:52:10.549090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: DELETE /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 HTTP/1.1 May 12 11:52:10.549090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:52:10.549090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:52:10.549090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:52:10.549090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:52:10.549090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:52:10.549090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:52:10.549090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:52:10.549090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:52:10.549090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPN72ankLKFrhJZR6C9M0dw-hZiyRt2TUcTdfesTpyCjr9OGMmXaA66OtYjMn8nYY67uZhB9uLgl0jwQoZVi3Y7RS0U9fP_Lye0Yg766PW_npIuypBUoIxJt9qk5Xad8asCqybumyRetKRLRv4rX8oQrT-L3kxEIm7ZFNVWac1-Kq08 May 12 11:52:10.549090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:52:10.549090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:52:10.549090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:52:10.549090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:52:10.549090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:52:10.549090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:52:10.549090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: d51975fc708d49efa56621b0fd19c47f May 12 11:52:10.549090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-AttachVolumeTestJSON-1858507414 May 12 11:52:10.549090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:52:10.549090 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:52:10.550628 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d51975fc708d49efa56621b0fd19c47f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d51975fc708d49efa56621b0fd19c47f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d51975fc708d49efa56621b0fd19c47f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d51975fc708d49efa56621b0fd19c47f", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:52:10.550628 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-AttachVolumeTestJSON-1858507414 May 12 11:52:10.550628 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: d51975fc708d49efa56621b0fd19c47f May 12 11:52:10.550628 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1858507414 May 12 11:52:10.550628 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-AttachVolumeTestJSON-1858507414-project May 12 11:52:10.550628 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:52:10.550628 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:52:10.550628 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 97227abbbafa46f1b0660e3be2ceea70 May 12 11:52:10.550628 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-AttachVolumeTestJSON-1858507414-project May 12 11:52:10.550628 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:52:10.550628 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance 53e646cc-6d91-43a7-bcf8-3b2b90228e12 could not be found. May 12 11:52:10.550628 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': '53e646cc-6d91-43a7-bcf8-3b2b90228e12'} May 12 11:52:10.551418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:52:10.551418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:10.551418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:52:10.551418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:52:10.551418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:52:10.551418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:52:10.551418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:52:10.551418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:52:10.551418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:52:10.551418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:52:10.551418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53e646cc-6d91-43a7-bcf8-3b2b90228e12 could not be found. May 12 11:52:10.551418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:10.551418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:52:10.551418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:10.551418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:10.551418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:52:10.551418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:52:10.551418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:52:10.551418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:52:10.551418 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:52:10.552638 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:52:10.552638 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 11:52:10.552638 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 11:52:10.552638 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 11:52:10.552638 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 11:52:10.552638 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:52:10.552638 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:52:10.552638 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:52:10.552638 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:52:10.552638 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53e646cc-6d91-43a7-bcf8-3b2b90228e12 could not be found. May 12 11:52:10.552638 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:10.552638 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:52:10.552638 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:10.552638 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:10.552638 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:52:10.552638 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:52:10.552638 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:52:10.552638 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:52:10.552638 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53e646cc-6d91-43a7-bcf8-3b2b90228e12 could not be found. May 12 11:52:10.552638 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:10.553836 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-e0b7252e-2dc2-45c4-9521-f12c56fbc21f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Returning 404 to user: Instance 53e646cc-6d91-43a7-bcf8-3b2b90228e12 could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:52:10.553836 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-e0b7252e-2dc2-45c4-9521-f12c56fbc21f tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "DELETE /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 404 len: 111 microversion: 2.1 time: 0.029023 May 12 11:52:10.553836 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 413/821] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:52:10 2022] DELETE /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:52:10.559177 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-2abf6d08-79ed-4e61-93f0-2b347228815c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:10.559904 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-2abf6d08-79ed-4e61-93f0-2b347228815c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 53e646cc-6d91-43a7-bcf8-3b2b90228e12] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:10.565973 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2abf6d08-79ed-4e61-93f0-2b347228815c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:10.566426 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2abf6d08-79ed-4e61-93f0-2b347228815c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:10.567188 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2abf6d08-79ed-4e61-93f0-2b347228815c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:10.567623 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2abf6d08-79ed-4e61-93f0-2b347228815c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:10.580376 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-2abf6d08-79ed-4e61-93f0-2b347228815c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] HTTP exception thrown: Instance 53e646cc-6d91-43a7-bcf8-3b2b90228e12 could not be found. May 12 11:52:10.582002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-2abf6d08-79ed-4e61-93f0-2b347228815c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Request method failure captured: May 12 11:52:10.582002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 HTTP/1.1 May 12 11:52:10.582002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:52:10.582002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:52:10.582002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:52:10.582002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 0 May 12 11:52:10.582002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:52:10.582002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:52:10.582002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:52:10.582002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:52:10.582002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPN72ankLKFrhJZR6C9M0dw-hZiyRt2TUcTdfesTpyCjr9OGMmXaA66OtYjMn8nYY67uZhB9uLgl0jwQoZVi3Y7RS0U9fP_Lye0Yg766PW_npIuypBUoIxJt9qk5Xad8asCqybumyRetKRLRv4rX8oQrT-L3kxEIm7ZFNVWac1-Kq08 May 12 11:52:10.582002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:52:10.582002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:52:10.582002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:52:10.582002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:52:10.582002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:52:10.582002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:52:10.582002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: d51975fc708d49efa56621b0fd19c47f May 12 11:52:10.582002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-AttachVolumeTestJSON-1858507414 May 12 11:52:10.582002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:52:10.582002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:52:10.583821 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d51975fc708d49efa56621b0fd19c47f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d51975fc708d49efa56621b0fd19c47f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d51975fc708d49efa56621b0fd19c47f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d51975fc708d49efa56621b0fd19c47f", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:52:10.583821 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-AttachVolumeTestJSON-1858507414 May 12 11:52:10.583821 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: d51975fc708d49efa56621b0fd19c47f May 12 11:52:10.583821 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1858507414 May 12 11:52:10.583821 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-AttachVolumeTestJSON-1858507414-project May 12 11:52:10.583821 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:52:10.583821 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:52:10.583821 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: 97227abbbafa46f1b0660e3be2ceea70 May 12 11:52:10.583821 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-AttachVolumeTestJSON-1858507414-project May 12 11:52:10.583821 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: > May 12 11:52:10.583821 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Instance 53e646cc-6d91-43a7-bcf8-3b2b90228e12 could not be found. May 12 11:52:10.583821 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'id': '53e646cc-6d91-43a7-bcf8-3b2b90228e12'} May 12 11:52:10.584917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:52:10.584917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:10.584917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:52:10.584917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:52:10.584917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:52:10.584917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:52:10.584917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:52:10.584917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:52:10.584917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:52:10.584917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:52:10.584917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53e646cc-6d91-43a7-bcf8-3b2b90228e12 could not be found. May 12 11:52:10.584917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:10.584917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:52:10.584917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:10.584917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:10.584917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:52:10.584917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:52:10.584917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:52:10.584917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:52:10.584917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:52:10.586337 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:52:10.586337 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:52:10.586337 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:52:10.586337 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:52:10.586337 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:52:10.586337 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:52:10.586337 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:52:10.586337 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53e646cc-6d91-43a7-bcf8-3b2b90228e12 could not be found. May 12 11:52:10.586337 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:10.586337 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:52:10.586337 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:10.586337 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:10.586337 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:52:10.586337 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:52:10.586337 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:52:10.586337 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:52:10.586337 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53e646cc-6d91-43a7-bcf8-3b2b90228e12 could not be found. May 12 11:52:10.586337 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:10.588397 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-2abf6d08-79ed-4e61-93f0-2b347228815c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Returning 404 to user: Instance 53e646cc-6d91-43a7-bcf8-3b2b90228e12 could not be found. {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:52:10.588397 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-2abf6d08-79ed-4e61-93f0-2b347228815c tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12" status: 404 len: 111 microversion: 2.1 time: 0.028820 May 12 11:52:10.588397 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 409/822] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:52:10 2022] GET /compute/v2.1/servers/53e646cc-6d91-43a7-bcf8-3b2b90228e12 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:52:10.963854 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-f4a3b897-5efc-424e-84f2-fe44f2945164 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:10.964846 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-f4a3b897-5efc-424e-84f2-fe44f2945164 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:10.970782 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f4a3b897-5efc-424e-84f2-fe44f2945164 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:10.971238 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f4a3b897-5efc-424e-84f2-fe44f2945164 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:10.972014 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f4a3b897-5efc-424e-84f2-fe44f2945164 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:10.972458 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f4a3b897-5efc-424e-84f2-fe44f2945164 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:10.999989 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-f4a3b897-5efc-424e-84f2-fe44f2945164 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040719 May 12 11:52:11.000540 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 414/823] 10.222.0.58 () {60 vars in 1342 bytes} [Thu May 12 11:52:10 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:52:11.058386 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-93c2c0d8-6f35-4404-b3c1-2597a7c909cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:11.058887 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-93c2c0d8-6f35-4404-b3c1-2597a7c909cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:11.064677 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-93c2c0d8-6f35-4404-b3c1-2597a7c909cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:11.065127 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-93c2c0d8-6f35-4404-b3c1-2597a7c909cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:11.065922 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-93c2c0d8-6f35-4404-b3c1-2597a7c909cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:11.066358 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-93c2c0d8-6f35-4404-b3c1-2597a7c909cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:11.092917 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-93c2c0d8-6f35-4404-b3c1-2597a7c909cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Going to try to terminate instance {{(pid=123507) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 11:52:11.164376 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-93c2c0d8-6f35-4404-b3c1-2597a7c909cd tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "DELETE /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 204 len: 0 microversion: 2.20 time: 0.109231 May 12 11:52:11.164900 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 410/824] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 12 11:52:11 2022] DELETE /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 11:52:11.173278 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-5dc4e72c-6440-4f0d-a04b-361b69cb2e45 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:11.173926 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-5dc4e72c-6440-4f0d-a04b-361b69cb2e45 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:11.179811 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5dc4e72c-6440-4f0d-a04b-361b69cb2e45 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:11.180268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5dc4e72c-6440-4f0d-a04b-361b69cb2e45 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:11.181036 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5dc4e72c-6440-4f0d-a04b-361b69cb2e45 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:11.181480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5dc4e72c-6440-4f0d-a04b-361b69cb2e45 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:11.309494 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-5dc4e72c-6440-4f0d-a04b-361b69cb2e45 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:11.319119 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-5dc4e72c-6440-4f0d-a04b-361b69cb2e45 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:11.321505 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-5dc4e72c-6440-4f0d-a04b-361b69cb2e45 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:11.323728 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-5dc4e72c-6440-4f0d-a04b-361b69cb2e45 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1723 microversion: 2.20 time: 0.154228 May 12 11:52:11.324263 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 415/825] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:52:11 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:52:11.715815 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-216d691c-feab-4ca6-bf8e-2c971edff66d tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:11.716396 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-216d691c-feab-4ca6-bf8e-2c971edff66d tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:11.722641 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-216d691c-feab-4ca6-bf8e-2c971edff66d tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:11.723090 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-216d691c-feab-4ca6-bf8e-2c971edff66d tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:11.723851 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-216d691c-feab-4ca6-bf8e-2c971edff66d tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:11.724286 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-216d691c-feab-4ca6-bf8e-2c971edff66d tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:11.737136 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-216d691c-feab-4ca6-bf8e-2c971edff66d tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] HTTP exception thrown: Instance 6bf4fa9e-950e-4be3-b042-517c2079c0f2 could not be found. May 12 11:52:11.738891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-216d691c-feab-4ca6-bf8e-2c971edff66d tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Request method failure captured: May 12 11:52:11.738891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: DELETE /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 HTTP/1.1 May 12 11:52:11.738891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:52:11.738891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:52:11.738891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:52:11.738891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 0 May 12 11:52:11.738891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:52:11.738891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:52:11.738891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:52:11.738891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:52:11.738891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPN72ankLKFrhJZR6C9M0dw-hZiyRt2TUcTdfesTpyCjr9OGMmXaA66OtYjMn8nYY67uZhB9uLgl0jwQoZVi3Y7RS0U9fP_Lye0Yg766PW_npIuypBUoIxJt9qk5Xad8asCqybumyRetKRLRv4rX8oQrT-L3kxEIm7ZFNVWac1-Kq08 May 12 11:52:11.738891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:52:11.738891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:52:11.738891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:52:11.738891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:52:11.738891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:52:11.738891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:52:11.738891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: d51975fc708d49efa56621b0fd19c47f May 12 11:52:11.738891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-AttachVolumeTestJSON-1858507414 May 12 11:52:11.738891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:52:11.738891 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:52:11.740372 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d51975fc708d49efa56621b0fd19c47f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d51975fc708d49efa56621b0fd19c47f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d51975fc708d49efa56621b0fd19c47f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d51975fc708d49efa56621b0fd19c47f", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:52:11.740372 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-AttachVolumeTestJSON-1858507414 May 12 11:52:11.740372 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: d51975fc708d49efa56621b0fd19c47f May 12 11:52:11.740372 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1858507414 May 12 11:52:11.740372 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-AttachVolumeTestJSON-1858507414-project May 12 11:52:11.740372 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:52:11.740372 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:52:11.740372 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: 97227abbbafa46f1b0660e3be2ceea70 May 12 11:52:11.740372 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-AttachVolumeTestJSON-1858507414-project May 12 11:52:11.740372 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: > May 12 11:52:11.740372 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Instance 6bf4fa9e-950e-4be3-b042-517c2079c0f2 could not be found. May 12 11:52:11.740372 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'id': '6bf4fa9e-950e-4be3-b042-517c2079c0f2'} May 12 11:52:11.741227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:52:11.741227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:11.741227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:52:11.741227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:52:11.741227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:52:11.741227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:52:11.741227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:52:11.741227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:52:11.741227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:52:11.741227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:52:11.741227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bf4fa9e-950e-4be3-b042-517c2079c0f2 could not be found. May 12 11:52:11.741227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:11.741227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:52:11.741227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:11.741227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:11.741227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:52:11.741227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:52:11.741227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:52:11.741227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:52:11.741227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:52:11.742653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:52:11.742653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 11:52:11.742653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 11:52:11.742653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 11:52:11.742653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 11:52:11.742653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:52:11.742653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:52:11.742653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:52:11.742653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:52:11.742653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bf4fa9e-950e-4be3-b042-517c2079c0f2 could not be found. May 12 11:52:11.742653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:11.742653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:52:11.742653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:11.742653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:11.742653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:52:11.742653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:52:11.742653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:52:11.742653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:52:11.742653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bf4fa9e-950e-4be3-b042-517c2079c0f2 could not be found. May 12 11:52:11.742653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:11.744307 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-216d691c-feab-4ca6-bf8e-2c971edff66d tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Returning 404 to user: Instance 6bf4fa9e-950e-4be3-b042-517c2079c0f2 could not be found. {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:52:11.744307 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-216d691c-feab-4ca6-bf8e-2c971edff66d tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 404 len: 111 microversion: 2.1 time: 0.029297 May 12 11:52:11.744307 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 411/826] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:52:11 2022] DELETE /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:52:11.748778 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ec0af2a9-ae02-473b-8f08-49cb4070e2bd tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:11.749392 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-ec0af2a9-ae02-473b-8f08-49cb4070e2bd tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] [instance: 6bf4fa9e-950e-4be3-b042-517c2079c0f2] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:11.755798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ec0af2a9-ae02-473b-8f08-49cb4070e2bd tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:11.756197 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ec0af2a9-ae02-473b-8f08-49cb4070e2bd tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:11.756976 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ec0af2a9-ae02-473b-8f08-49cb4070e2bd tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:11.757419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ec0af2a9-ae02-473b-8f08-49cb4070e2bd tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:11.772443 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-ec0af2a9-ae02-473b-8f08-49cb4070e2bd tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] HTTP exception thrown: Instance 6bf4fa9e-950e-4be3-b042-517c2079c0f2 could not be found. May 12 11:52:11.773975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ec0af2a9-ae02-473b-8f08-49cb4070e2bd tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Request method failure captured: May 12 11:52:11.773975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 HTTP/1.1 May 12 11:52:11.773975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:52:11.773975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:52:11.773975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:52:11.773975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:52:11.773975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:52:11.773975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:52:11.773975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:52:11.773975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:52:11.773975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPN72ankLKFrhJZR6C9M0dw-hZiyRt2TUcTdfesTpyCjr9OGMmXaA66OtYjMn8nYY67uZhB9uLgl0jwQoZVi3Y7RS0U9fP_Lye0Yg766PW_npIuypBUoIxJt9qk5Xad8asCqybumyRetKRLRv4rX8oQrT-L3kxEIm7ZFNVWac1-Kq08 May 12 11:52:11.773975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:52:11.773975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:52:11.773975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:52:11.773975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:52:11.773975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:52:11.773975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:52:11.773975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: d51975fc708d49efa56621b0fd19c47f May 12 11:52:11.773975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-AttachVolumeTestJSON-1858507414 May 12 11:52:11.773975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:52:11.773975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:52:11.776192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d51975fc708d49efa56621b0fd19c47f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d51975fc708d49efa56621b0fd19c47f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d51975fc708d49efa56621b0fd19c47f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d51975fc708d49efa56621b0fd19c47f", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:52:11.776192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-AttachVolumeTestJSON-1858507414 May 12 11:52:11.776192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: d51975fc708d49efa56621b0fd19c47f May 12 11:52:11.776192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1858507414 May 12 11:52:11.776192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-AttachVolumeTestJSON-1858507414-project May 12 11:52:11.776192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:52:11.776192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:52:11.776192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 97227abbbafa46f1b0660e3be2ceea70 May 12 11:52:11.776192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-AttachVolumeTestJSON-1858507414-project May 12 11:52:11.776192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:52:11.776192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance 6bf4fa9e-950e-4be3-b042-517c2079c0f2 could not be found. May 12 11:52:11.776192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': '6bf4fa9e-950e-4be3-b042-517c2079c0f2'} May 12 11:52:11.777114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:52:11.777114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:11.777114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:52:11.777114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:52:11.777114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:52:11.777114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:52:11.777114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:52:11.777114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:52:11.777114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:52:11.777114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:52:11.777114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bf4fa9e-950e-4be3-b042-517c2079c0f2 could not be found. May 12 11:52:11.777114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:11.777114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:52:11.777114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:11.777114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:11.777114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:52:11.777114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:52:11.777114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:52:11.777114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:52:11.777114 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:52:11.778531 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:52:11.778531 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:52:11.778531 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:52:11.778531 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:52:11.778531 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:52:11.778531 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:52:11.778531 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:52:11.778531 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bf4fa9e-950e-4be3-b042-517c2079c0f2 could not be found. May 12 11:52:11.778531 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:11.778531 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:52:11.778531 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:11.778531 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:11.778531 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:52:11.778531 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:52:11.778531 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:52:11.778531 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:52:11.778531 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bf4fa9e-950e-4be3-b042-517c2079c0f2 could not be found. May 12 11:52:11.778531 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:11.779762 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ec0af2a9-ae02-473b-8f08-49cb4070e2bd tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] Returning 404 to user: Instance 6bf4fa9e-950e-4be3-b042-517c2079c0f2 could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:52:11.779762 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-ec0af2a9-ae02-473b-8f08-49cb4070e2bd tempest-AttachVolumeTestJSON-1858507414 tempest-AttachVolumeTestJSON-1858507414-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2" status: 404 len: 111 microversion: 2.1 time: 0.030679 May 12 11:52:11.779762 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 416/827] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:52:11 2022] GET /compute/v2.1/servers/6bf4fa9e-950e-4be3-b042-517c2079c0f2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:52:12.342079 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-b688bbc6-0a0a-4ec2-93b3-d23de7b2028c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:12.342790 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-b688bbc6-0a0a-4ec2-93b3-d23de7b2028c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:12.349865 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b688bbc6-0a0a-4ec2-93b3-d23de7b2028c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:12.350394 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b688bbc6-0a0a-4ec2-93b3-d23de7b2028c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:12.351263 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b688bbc6-0a0a-4ec2-93b3-d23de7b2028c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:12.351785 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b688bbc6-0a0a-4ec2-93b3-d23de7b2028c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:12.546040 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b688bbc6-0a0a-4ec2-93b3-d23de7b2028c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:12.553814 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b688bbc6-0a0a-4ec2-93b3-d23de7b2028c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:12.555321 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b688bbc6-0a0a-4ec2-93b3-d23de7b2028c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:12.556480 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-b688bbc6-0a0a-4ec2-93b3-d23de7b2028c tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1723 microversion: 2.20 time: 0.218252 May 12 11:52:12.557592 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 412/828] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:52:12 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:52:13.575506 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ab9c254b-5571-48e6-9839-ab152cbb446d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:13.576107 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-ab9c254b-5571-48e6-9839-ab152cbb446d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:13.582437 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ab9c254b-5571-48e6-9839-ab152cbb446d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:13.582882 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ab9c254b-5571-48e6-9839-ab152cbb446d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:13.583903 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ab9c254b-5571-48e6-9839-ab152cbb446d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:13.584340 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ab9c254b-5571-48e6-9839-ab152cbb446d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:13.646825 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-ab9c254b-5571-48e6-9839-ab152cbb446d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:13.654729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-ab9c254b-5571-48e6-9839-ab152cbb446d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:13.656219 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-ab9c254b-5571-48e6-9839-ab152cbb446d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:13.657406 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-ab9c254b-5571-48e6-9839-ab152cbb446d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1656 microversion: 2.20 time: 0.086462 May 12 11:52:13.657980 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 417/829] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:52:13 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1656 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:52:14.269090 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-b9ce10e9-5770-41ac-80a8-5af0d81b5c13 req-7b32bb8f-72f9-4592-8cac-f80a20306611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efbc8e04-31bd-4238-8c9a-096ad87a46ab", "name": "network-vif-deleted", "tag": "e62c63ee-3f94-4556-b00c-c45c7465fd0e"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:52:14.296236 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-b9ce10e9-5770-41ac-80a8-5af0d81b5c13 req-7b32bb8f-72f9-4592-8cac-f80a20306611 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:14.297784 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-b9ce10e9-5770-41ac-80a8-5af0d81b5c13 req-7b32bb8f-72f9-4592-8cac-f80a20306611 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:14.327487 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-b9ce10e9-5770-41ac-80a8-5af0d81b5c13 req-7b32bb8f-72f9-4592-8cac-f80a20306611 service nova] Creating event network-vif-deleted:e62c63ee-3f94-4556-b00c-c45c7465fd0e for instance efbc8e04-31bd-4238-8c9a-096ad87a46ab on hv-cinder-80473 May 12 11:52:14.339574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-b9ce10e9-5770-41ac-80a8-5af0d81b5c13 req-7b32bb8f-72f9-4592-8cac-f80a20306611 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078249 May 12 11:52:14.341744 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 413/830] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:52:14.675516 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-60ab6b23-1ecd-4c82-bfc9-f750f47e73d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:14.676115 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-60ab6b23-1ecd-4c82-bfc9-f750f47e73d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:14.684315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-60ab6b23-1ecd-4c82-bfc9-f750f47e73d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:14.684767 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-60ab6b23-1ecd-4c82-bfc9-f750f47e73d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:14.685548 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-60ab6b23-1ecd-4c82-bfc9-f750f47e73d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:14.687481 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-60ab6b23-1ecd-4c82-bfc9-f750f47e73d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:14.744515 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-60ab6b23-1ecd-4c82-bfc9-f750f47e73d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:14.745310 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-60ab6b23-1ecd-4c82-bfc9-f750f47e73d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:14.746206 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.objects.instance [None req-60ab6b23-1ecd-4c82-bfc9-f750f47e73d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lazy-loading 'fault' on Instance uuid efbc8e04-31bd-4238-8c9a-096ad87a46ab {{(pid=123508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:52:14.795519 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-60ab6b23-1ecd-4c82-bfc9-f750f47e73d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:14.805883 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-60ab6b23-1ecd-4c82-bfc9-f750f47e73d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:14.808020 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-60ab6b23-1ecd-4c82-bfc9-f750f47e73d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '635d1cf64110483b843b01e6e6ddc749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079cb1c02174440091d4c5bcbc27bdc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:14.809646 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-60ab6b23-1ecd-4c82-bfc9-f750f47e73d3 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 200 len: 1372 microversion: 2.20 time: 0.137753 May 12 11:52:14.820763 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 418/831] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:52:14 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 1372 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 11:52:15.829203 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-49bccc2d-a09d-4448-8552-9d261b11a61d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:15.829855 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-49bccc2d-a09d-4448-8552-9d261b11a61d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:15.842391 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-49bccc2d-a09d-4448-8552-9d261b11a61d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:15.842951 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-49bccc2d-a09d-4448-8552-9d261b11a61d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:15.849797 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-49bccc2d-a09d-4448-8552-9d261b11a61d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:15.850314 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-49bccc2d-a09d-4448-8552-9d261b11a61d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:15.867876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-49bccc2d-a09d-4448-8552-9d261b11a61d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] HTTP exception thrown: Instance efbc8e04-31bd-4238-8c9a-096ad87a46ab could not be found. May 12 11:52:15.869548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-49bccc2d-a09d-4448-8552-9d261b11a61d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Request method failure captured: May 12 11:52:15.869548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab HTTP/1.1 May 12 11:52:15.869548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:52:15.869548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:52:15.869548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:52:15.869548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 0 May 12 11:52:15.869548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:52:15.869548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:52:15.869548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:52:15.869548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:52:15.869548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPNAJBskQ01M3Bd-pOdrqHnMkzj_IA3v-gV_GKs3p_RPwGyRb5_ums4Nt3oztaW2WD7kvjB_YHdu35UolYaZX08nADmNaUOGWRxSAflC1nPoI10kF90cbescoL5ieRAIeNUHGbBmJN57yMlM6qJdGVdAnzym-VeousEAjmnedXsQZCs May 12 11:52:15.869548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:52:15.869548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:52:15.869548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:52:15.869548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:52:15.869548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Openstack-Nova-Api-Version: 2.20 May 12 11:52:15.869548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:52:15.869548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:52:15.869548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: 079cb1c02174440091d4c5bcbc27bdc5 May 12 11:52:15.869548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1052935867 May 12 11:52:15.869548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:52:15.869548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:52:15.871225 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/079cb1c02174440091d4c5bcbc27bdc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/079cb1c02174440091d4c5bcbc27bdc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/079cb1c02174440091d4c5bcbc27bdc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_079cb1c02174440091d4c5bcbc27bdc5", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:52:15.871225 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1052935867 May 12 11:52:15.871225 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: 079cb1c02174440091d4c5bcbc27bdc5 May 12 11:52:15.871225 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1052935867 May 12 11:52:15.871225 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-AttachVolumeShelveTestJSON-1052935867-project May 12 11:52:15.871225 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:52:15.871225 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:52:15.871225 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: 635d1cf64110483b843b01e6e6ddc749 May 12 11:52:15.871225 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1052935867-project May 12 11:52:15.871225 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: > May 12 11:52:15.871225 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Instance efbc8e04-31bd-4238-8c9a-096ad87a46ab could not be found. May 12 11:52:15.871225 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'id': 'efbc8e04-31bd-4238-8c9a-096ad87a46ab'} May 12 11:52:15.871982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:52:15.871982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:15.871982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:52:15.871982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:52:15.871982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:52:15.871982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:52:15.871982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:52:15.871982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:52:15.871982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:52:15.871982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:52:15.871982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efbc8e04-31bd-4238-8c9a-096ad87a46ab could not be found. May 12 11:52:15.871982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:15.871982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:52:15.871982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:15.871982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:15.871982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:52:15.871982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:52:15.871982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:52:15.871982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:52:15.871982 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:52:15.873287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:52:15.873287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:52:15.873287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:52:15.873287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:52:15.873287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:52:15.873287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:52:15.873287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:52:15.873287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efbc8e04-31bd-4238-8c9a-096ad87a46ab could not be found. May 12 11:52:15.873287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:15.873287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:52:15.873287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:15.873287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:15.873287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:52:15.873287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:52:15.873287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:52:15.873287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:52:15.873287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efbc8e04-31bd-4238-8c9a-096ad87a46ab could not be found. May 12 11:52:15.873287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:15.874474 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-49bccc2d-a09d-4448-8552-9d261b11a61d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Returning 404 to user: Instance efbc8e04-31bd-4238-8c9a-096ad87a46ab could not be found. {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:52:15.874474 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-49bccc2d-a09d-4448-8552-9d261b11a61d tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 404 len: 111 microversion: 2.20 time: 0.046182 May 12 11:52:15.884933 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-1b01ecf4-5d1a-4517-a3e0-6cc0637ef5b5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '.version_select at 0x7f29f2371940>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:15.886406 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 414/832] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:52:15 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 11:52:15.903570 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-1b01ecf4-5d1a-4517-a3e0-6cc0637ef5b5 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320910538" status: 204 len: 0 microversion: 2.20 time: 0.027413 May 12 11:52:15.904249 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 419/833] 10.222.0.58 () {60 vars in 1261 bytes} [Thu May 12 11:52:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320910538 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 11:52:17.174961 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-f9cc9b3f-7820-4fb5-8097-664112465257 tempest-VolumesGetTestJSON-1040259155 tempest-VolumesGetTestJSON-1040259155-project] Action: 'create', calling method: .version_select at 0x7f29f1ce0700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-126500393", "metadata": {"Type": "work"}}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:52:17.446280 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-f9cc9b3f-7820-4fb5-8097-664112465257 tempest-VolumesGetTestJSON-1040259155 tempest-VolumesGetTestJSON-1040259155-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.381475 May 12 11:52:17.446901 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 415/834] 10.222.0.58 () {60 vars in 1155 bytes} [Thu May 12 11:52:17 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 383 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 12 11:52:17.459517 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a40df00e-29c5-4e47-b4b0-5ad63895ecc5 tempest-VolumesGetTestJSON-1040259155 tempest-VolumesGetTestJSON-1040259155-project] Calling method '.version_select at 0x7f29f245e310>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:17.508151 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-a40df00e-29c5-4e47-b4b0-5ad63895ecc5 tempest-VolumesGetTestJSON-1040259155 tempest-VolumesGetTestJSON-1040259155-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/5189255d-e216-4994-b802-a0ada41012aa" status: 200 len: 352 microversion: 2.1 time: 0.054101 May 12 11:52:17.508793 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 420/835] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 12 11:52:17 2022] GET /compute/v2.1/os-volumes/5189255d-e216-4994-b802-a0ada41012aa => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:52:17.691996 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-582c574f-281d-4d87-b0e1-befa9865112a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:17.692497 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-582c574f-281d-4d87-b0e1-befa9865112a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:17.699708 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-582c574f-281d-4d87-b0e1-befa9865112a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:17.700159 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-582c574f-281d-4d87-b0e1-befa9865112a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:17.700920 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-582c574f-281d-4d87-b0e1-befa9865112a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:17.701362 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-582c574f-281d-4d87-b0e1-befa9865112a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:17.714870 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-582c574f-281d-4d87-b0e1-befa9865112a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] HTTP exception thrown: Instance efbc8e04-31bd-4238-8c9a-096ad87a46ab could not be found. May 12 11:52:17.716400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-582c574f-281d-4d87-b0e1-befa9865112a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Request method failure captured: May 12 11:52:17.716400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: DELETE /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab HTTP/1.1 May 12 11:52:17.716400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:52:17.716400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:52:17.716400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:52:17.716400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 0 May 12 11:52:17.716400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:52:17.716400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:52:17.716400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:52:17.716400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:52:17.716400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPNAJBskQ01M3Bd-pOdrqHnMkzj_IA3v-gV_GKs3p_RPwGyRb5_ums4Nt3oztaW2WD7kvjB_YHdu35UolYaZX08nADmNaUOGWRxSAflC1nPoI10kF90cbescoL5ieRAIeNUHGbBmJN57yMlM6qJdGVdAnzym-VeousEAjmnedXsQZCs May 12 11:52:17.716400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:52:17.716400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:52:17.716400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:52:17.716400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:52:17.716400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Openstack-Nova-Api-Version: 2.20 May 12 11:52:17.716400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:52:17.716400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:52:17.716400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: 079cb1c02174440091d4c5bcbc27bdc5 May 12 11:52:17.716400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1052935867 May 12 11:52:17.716400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:52:17.716400 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:52:17.718062 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/079cb1c02174440091d4c5bcbc27bdc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/079cb1c02174440091d4c5bcbc27bdc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/079cb1c02174440091d4c5bcbc27bdc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_079cb1c02174440091d4c5bcbc27bdc5", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:52:17.718062 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1052935867 May 12 11:52:17.718062 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: 079cb1c02174440091d4c5bcbc27bdc5 May 12 11:52:17.718062 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1052935867 May 12 11:52:17.718062 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-AttachVolumeShelveTestJSON-1052935867-project May 12 11:52:17.718062 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:52:17.718062 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:52:17.718062 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: 635d1cf64110483b843b01e6e6ddc749 May 12 11:52:17.718062 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1052935867-project May 12 11:52:17.718062 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: > May 12 11:52:17.718062 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Instance efbc8e04-31bd-4238-8c9a-096ad87a46ab could not be found. May 12 11:52:17.718062 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'id': 'efbc8e04-31bd-4238-8c9a-096ad87a46ab'} May 12 11:52:17.721554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:52:17.721554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:17.721554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:52:17.721554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:52:17.721554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:52:17.721554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:52:17.721554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:52:17.721554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:52:17.721554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:52:17.721554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:52:17.721554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efbc8e04-31bd-4238-8c9a-096ad87a46ab could not be found. May 12 11:52:17.721554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:17.721554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:52:17.721554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:17.721554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:17.721554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:52:17.721554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:52:17.721554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:52:17.721554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:52:17.721554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:52:17.722985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:52:17.722985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 11:52:17.722985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 11:52:17.722985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 11:52:17.722985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 11:52:17.722985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:52:17.722985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:52:17.722985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:52:17.722985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:52:17.722985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efbc8e04-31bd-4238-8c9a-096ad87a46ab could not be found. May 12 11:52:17.722985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:17.722985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:52:17.722985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:17.722985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:17.722985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:52:17.722985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:52:17.722985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:52:17.722985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:52:17.722985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efbc8e04-31bd-4238-8c9a-096ad87a46ab could not be found. May 12 11:52:17.722985 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:17.724411 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-582c574f-281d-4d87-b0e1-befa9865112a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Returning 404 to user: Instance efbc8e04-31bd-4238-8c9a-096ad87a46ab could not be found. {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:52:17.724411 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-582c574f-281d-4d87-b0e1-befa9865112a tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "DELETE /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 404 len: 111 microversion: 2.20 time: 0.029740 May 12 11:52:17.724411 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 416/836] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 12 11:52:17 2022] DELETE /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 11:52:17.725844 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-4f9009ff-be4c-49e2-8e41-1619a2fcbb51 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:17.726460 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-4f9009ff-be4c-49e2-8e41-1619a2fcbb51 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: efbc8e04-31bd-4238-8c9a-096ad87a46ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:17.732943 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4f9009ff-be4c-49e2-8e41-1619a2fcbb51 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:17.733399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4f9009ff-be4c-49e2-8e41-1619a2fcbb51 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:17.734216 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4f9009ff-be4c-49e2-8e41-1619a2fcbb51 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:17.734656 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4f9009ff-be4c-49e2-8e41-1619a2fcbb51 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:17.747391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-4f9009ff-be4c-49e2-8e41-1619a2fcbb51 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] HTTP exception thrown: Instance efbc8e04-31bd-4238-8c9a-096ad87a46ab could not be found. May 12 11:52:17.748908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-4f9009ff-be4c-49e2-8e41-1619a2fcbb51 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Request method failure captured: May 12 11:52:17.748908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab HTTP/1.1 May 12 11:52:17.748908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:52:17.748908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:52:17.748908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:52:17.748908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:52:17.748908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:52:17.748908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:52:17.748908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:52:17.748908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:52:17.748908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPNAJBskQ01M3Bd-pOdrqHnMkzj_IA3v-gV_GKs3p_RPwGyRb5_ums4Nt3oztaW2WD7kvjB_YHdu35UolYaZX08nADmNaUOGWRxSAflC1nPoI10kF90cbescoL5ieRAIeNUHGbBmJN57yMlM6qJdGVdAnzym-VeousEAjmnedXsQZCs May 12 11:52:17.748908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:52:17.748908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:52:17.748908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:52:17.748908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:52:17.748908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Openstack-Nova-Api-Version: 2.20 May 12 11:52:17.748908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:52:17.748908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:52:17.748908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: 079cb1c02174440091d4c5bcbc27bdc5 May 12 11:52:17.748908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1052935867 May 12 11:52:17.748908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:52:17.748908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:52:17.750541 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/079cb1c02174440091d4c5bcbc27bdc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/079cb1c02174440091d4c5bcbc27bdc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/079cb1c02174440091d4c5bcbc27bdc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_079cb1c02174440091d4c5bcbc27bdc5", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:52:17.750541 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1052935867 May 12 11:52:17.750541 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: 079cb1c02174440091d4c5bcbc27bdc5 May 12 11:52:17.750541 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1052935867 May 12 11:52:17.750541 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-AttachVolumeShelveTestJSON-1052935867-project May 12 11:52:17.750541 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:52:17.750541 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:52:17.750541 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 635d1cf64110483b843b01e6e6ddc749 May 12 11:52:17.750541 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1052935867-project May 12 11:52:17.750541 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:52:17.750541 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance efbc8e04-31bd-4238-8c9a-096ad87a46ab could not be found. May 12 11:52:17.750541 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': 'efbc8e04-31bd-4238-8c9a-096ad87a46ab'} May 12 11:52:17.751419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:52:17.751419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:17.751419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:52:17.751419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:52:17.751419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:52:17.751419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:52:17.751419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:52:17.751419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:52:17.751419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:52:17.751419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:52:17.751419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efbc8e04-31bd-4238-8c9a-096ad87a46ab could not be found. May 12 11:52:17.751419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:17.751419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:52:17.751419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:17.751419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:17.751419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:52:17.751419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:52:17.751419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:52:17.751419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:52:17.751419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:52:17.752861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:52:17.752861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:52:17.752861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:52:17.752861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:52:17.752861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:52:17.752861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:52:17.752861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:52:17.752861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efbc8e04-31bd-4238-8c9a-096ad87a46ab could not be found. May 12 11:52:17.752861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:17.752861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:52:17.752861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:17.752861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:17.752861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:52:17.752861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:52:17.752861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:52:17.752861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:52:17.752861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efbc8e04-31bd-4238-8c9a-096ad87a46ab could not be found. May 12 11:52:17.752861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:17.754407 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-4f9009ff-be4c-49e2-8e41-1619a2fcbb51 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Returning 404 to user: Instance efbc8e04-31bd-4238-8c9a-096ad87a46ab could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:52:17.754407 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-4f9009ff-be4c-49e2-8e41-1619a2fcbb51 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab" status: 404 len: 111 microversion: 2.20 time: 0.028278 May 12 11:52:17.754407 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 421/837] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:52:17 2022] GET /compute/v2.1/servers/efbc8e04-31bd-4238-8c9a-096ad87a46ab => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 12 11:52:18.520256 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-a6d179d2-5eeb-4d2f-b4ba-5de54d3bdf29 tempest-VolumesGetTestJSON-1040259155 tempest-VolumesGetTestJSON-1040259155-project] Calling method '.version_select at 0x7f29f1fae430>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:18.565436 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-a6d179d2-5eeb-4d2f-b4ba-5de54d3bdf29 tempest-VolumesGetTestJSON-1040259155 tempest-VolumesGetTestJSON-1040259155-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/5189255d-e216-4994-b802-a0ada41012aa" status: 200 len: 353 microversion: 2.1 time: 0.048922 May 12 11:52:18.566051 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 417/838] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 12 11:52:18 2022] GET /compute/v2.1/os-volumes/5189255d-e216-4994-b802-a0ada41012aa => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:52:18.577141 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-af2c6dc2-28a5-4b25-b518-5468ff162bef tempest-VolumesGetTestJSON-1040259155 tempest-VolumesGetTestJSON-1040259155-project] Calling method '.version_select at 0x7f29f30ceee0>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:18.623506 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-af2c6dc2-28a5-4b25-b518-5468ff162bef tempest-VolumesGetTestJSON-1040259155 tempest-VolumesGetTestJSON-1040259155-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/5189255d-e216-4994-b802-a0ada41012aa" status: 200 len: 353 microversion: 2.1 time: 0.050620 May 12 11:52:18.624057 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 422/839] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 12 11:52:18 2022] GET /compute/v2.1/os-volumes/5189255d-e216-4994-b802-a0ada41012aa => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:52:18.639547 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-1faa64c2-c14a-4053-bd4a-83ef76067471 tempest-VolumesGetTestJSON-1040259155 tempest-VolumesGetTestJSON-1040259155-project] Calling method '.version_select at 0x7f29f7802ee0>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:18.700214 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-1faa64c2-c14a-4053-bd4a-83ef76067471 tempest-VolumesGetTestJSON-1040259155 tempest-VolumesGetTestJSON-1040259155-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/5189255d-e216-4994-b802-a0ada41012aa" status: 202 len: 0 microversion: 2.1 time: 0.064332 May 12 11:52:18.700800 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 418/840] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 12 11:52:18 2022] DELETE /compute/v2.1/os-volumes/5189255d-e216-4994-b802-a0ada41012aa => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:52:18.709429 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b12ea007-4f95-4f6d-878b-087d404d0bb1 tempest-VolumesGetTestJSON-1040259155 tempest-VolumesGetTestJSON-1040259155-project] Calling method '.version_select at 0x7f29f2313d30>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:18.755779 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-b12ea007-4f95-4f6d-878b-087d404d0bb1 tempest-VolumesGetTestJSON-1040259155 tempest-VolumesGetTestJSON-1040259155-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/5189255d-e216-4994-b802-a0ada41012aa" status: 200 len: 352 microversion: 2.1 time: 0.050343 May 12 11:52:18.756344 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 423/841] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 12 11:52:18 2022] GET /compute/v2.1/os-volumes/5189255d-e216-4994-b802-a0ada41012aa => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:52:18.880852 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-3731675f-f026-4681-ad81-95d58102c328 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:18.881417 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-3731675f-f026-4681-ad81-95d58102c328 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:18.888202 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3731675f-f026-4681-ad81-95d58102c328 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:18.888741 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3731675f-f026-4681-ad81-95d58102c328 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:18.889616 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3731675f-f026-4681-ad81-95d58102c328 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:18.890081 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3731675f-f026-4681-ad81-95d58102c328 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:18.903374 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-3731675f-f026-4681-ad81-95d58102c328 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] HTTP exception thrown: Instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 could not be found. May 12 11:52:18.904894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-3731675f-f026-4681-ad81-95d58102c328 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Request method failure captured: May 12 11:52:18.904894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: DELETE /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 HTTP/1.1 May 12 11:52:18.904894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:52:18.904894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:52:18.904894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:52:18.904894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 0 May 12 11:52:18.904894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:52:18.904894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:52:18.904894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:52:18.904894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:52:18.904894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPNAJBskQ01M3Bd-pOdrqHnMkzj_IA3v-gV_GKs3p_RPwGyRb5_ums4Nt3oztaW2WD7kvjB_YHdu35UolYaZX08nADmNaUOGWRxSAflC1nPoI10kF90cbescoL5ieRAIeNUHGbBmJN57yMlM6qJdGVdAnzym-VeousEAjmnedXsQZCs May 12 11:52:18.904894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:52:18.904894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:52:18.904894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:52:18.904894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:52:18.904894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Openstack-Nova-Api-Version: 2.20 May 12 11:52:18.904894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:52:18.904894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:52:18.904894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: 079cb1c02174440091d4c5bcbc27bdc5 May 12 11:52:18.904894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1052935867 May 12 11:52:18.904894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:52:18.904894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:52:18.906527 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/079cb1c02174440091d4c5bcbc27bdc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/079cb1c02174440091d4c5bcbc27bdc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/079cb1c02174440091d4c5bcbc27bdc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_079cb1c02174440091d4c5bcbc27bdc5", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:52:18.906527 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1052935867 May 12 11:52:18.906527 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: 079cb1c02174440091d4c5bcbc27bdc5 May 12 11:52:18.906527 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1052935867 May 12 11:52:18.906527 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-AttachVolumeShelveTestJSON-1052935867-project May 12 11:52:18.906527 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:52:18.906527 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:52:18.906527 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: 635d1cf64110483b843b01e6e6ddc749 May 12 11:52:18.906527 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1052935867-project May 12 11:52:18.906527 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: > May 12 11:52:18.906527 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 could not be found. May 12 11:52:18.906527 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'id': 'c5cd2aad-2374-4ded-8b72-2e54fbbad916'} May 12 11:52:18.907521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:52:18.907521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:18.907521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:52:18.907521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:52:18.907521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:52:18.907521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:52:18.907521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:52:18.907521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:52:18.907521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:52:18.907521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:52:18.907521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 could not be found. May 12 11:52:18.907521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:18.907521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:52:18.907521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:18.907521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:18.907521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:52:18.907521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:52:18.907521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:52:18.907521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:52:18.907521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:52:18.908975 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:52:18.908975 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 11:52:18.908975 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 11:52:18.908975 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 11:52:18.908975 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 11:52:18.908975 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:52:18.908975 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:52:18.908975 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:52:18.908975 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:52:18.908975 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 could not be found. May 12 11:52:18.908975 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:18.908975 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:52:18.908975 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:18.908975 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:18.908975 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:52:18.908975 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:52:18.908975 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:52:18.908975 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:52:18.908975 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 could not be found. May 12 11:52:18.908975 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:18.910591 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-3731675f-f026-4681-ad81-95d58102c328 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Returning 404 to user: Instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 could not be found. {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:52:18.910591 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-3731675f-f026-4681-ad81-95d58102c328 tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 404 len: 111 microversion: 2.20 time: 0.029381 May 12 11:52:18.910591 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 419/842] 10.222.0.58 () {60 vars in 1279 bytes} [Thu May 12 11:52:18 2022] DELETE /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 11:52:18.915981 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-e5e7ba3a-cc34-4149-8aef-410feeb7fdab tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:18.917239 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-e5e7ba3a-cc34-4149-8aef-410feeb7fdab tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] [instance: c5cd2aad-2374-4ded-8b72-2e54fbbad916] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:18.923352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e5e7ba3a-cc34-4149-8aef-410feeb7fdab tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:18.923801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e5e7ba3a-cc34-4149-8aef-410feeb7fdab tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:18.924570 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e5e7ba3a-cc34-4149-8aef-410feeb7fdab tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:18.925011 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e5e7ba3a-cc34-4149-8aef-410feeb7fdab tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:18.937991 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-e5e7ba3a-cc34-4149-8aef-410feeb7fdab tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] HTTP exception thrown: Instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 could not be found. May 12 11:52:18.939801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-e5e7ba3a-cc34-4149-8aef-410feeb7fdab tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Request method failure captured: May 12 11:52:18.939801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 HTTP/1.1 May 12 11:52:18.939801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:52:18.939801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:52:18.939801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:52:18.939801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:52:18.939801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:52:18.939801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:52:18.939801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:52:18.939801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:52:18.939801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPNAJBskQ01M3Bd-pOdrqHnMkzj_IA3v-gV_GKs3p_RPwGyRb5_ums4Nt3oztaW2WD7kvjB_YHdu35UolYaZX08nADmNaUOGWRxSAflC1nPoI10kF90cbescoL5ieRAIeNUHGbBmJN57yMlM6qJdGVdAnzym-VeousEAjmnedXsQZCs May 12 11:52:18.939801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:52:18.939801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:52:18.939801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:52:18.939801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:52:18.939801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Openstack-Nova-Api-Version: 2.20 May 12 11:52:18.939801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:52:18.939801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:52:18.939801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: 079cb1c02174440091d4c5bcbc27bdc5 May 12 11:52:18.939801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1052935867 May 12 11:52:18.939801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:52:18.939801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:52:18.941739 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/079cb1c02174440091d4c5bcbc27bdc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/079cb1c02174440091d4c5bcbc27bdc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/079cb1c02174440091d4c5bcbc27bdc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_079cb1c02174440091d4c5bcbc27bdc5", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:52:18.941739 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1052935867 May 12 11:52:18.941739 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: 079cb1c02174440091d4c5bcbc27bdc5 May 12 11:52:18.941739 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1052935867 May 12 11:52:18.941739 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-AttachVolumeShelveTestJSON-1052935867-project May 12 11:52:18.941739 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:52:18.941739 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:52:18.941739 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 635d1cf64110483b843b01e6e6ddc749 May 12 11:52:18.941739 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1052935867-project May 12 11:52:18.941739 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:52:18.941739 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 could not be found. May 12 11:52:18.941739 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': 'c5cd2aad-2374-4ded-8b72-2e54fbbad916'} May 12 11:52:18.946281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:52:18.946281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:18.946281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:52:18.946281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:52:18.946281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:52:18.946281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:52:18.946281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:52:18.946281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:52:18.946281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:52:18.946281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:52:18.946281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 could not be found. May 12 11:52:18.946281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:18.946281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:52:18.946281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:18.946281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:18.946281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:52:18.946281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:52:18.946281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:52:18.946281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:52:18.946281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:52:18.948618 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:52:18.948618 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:52:18.948618 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:52:18.948618 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:52:18.948618 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:52:18.948618 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:52:18.948618 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:52:18.948618 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 could not be found. May 12 11:52:18.948618 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:18.948618 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:52:18.948618 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:18.948618 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:18.948618 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:52:18.948618 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:52:18.948618 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:52:18.948618 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:52:18.948618 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 could not be found. May 12 11:52:18.948618 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:52:18.950152 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-e5e7ba3a-cc34-4149-8aef-410feeb7fdab tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] Returning 404 to user: Instance c5cd2aad-2374-4ded-8b72-2e54fbbad916 could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:52:18.950152 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-e5e7ba3a-cc34-4149-8aef-410feeb7fdab tempest-AttachVolumeShelveTestJSON-1052935867 tempest-AttachVolumeShelveTestJSON-1052935867-project] 10.222.0.58 "GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916" status: 404 len: 111 microversion: 2.20 time: 0.029461 May 12 11:52:18.950152 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 424/843] 10.222.0.58 () {60 vars in 1276 bytes} [Thu May 12 11:52:18 2022] GET /compute/v2.1/servers/c5cd2aad-2374-4ded-8b72-2e54fbbad916 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 11:52:19.768115 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-7d5952e6-43bf-4afc-8de6-62cf95897f83 tempest-VolumesGetTestJSON-1040259155 tempest-VolumesGetTestJSON-1040259155-project] Calling method '.version_select at 0x7f29f1d1fdc0>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:19.796520 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-7d5952e6-43bf-4afc-8de6-62cf95897f83 tempest-VolumesGetTestJSON-1040259155 tempest-VolumesGetTestJSON-1040259155-project] HTTP exception thrown: Volume 5189255d-e216-4994-b802-a0ada41012aa could not be found. May 12 11:52:19.798603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-7d5952e6-43bf-4afc-8de6-62cf95897f83 tempest-VolumesGetTestJSON-1040259155 tempest-VolumesGetTestJSON-1040259155-project] Request method failure captured: May 12 11:52:19.798603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: GET /compute/v2.1/os-volumes/5189255d-e216-4994-b802-a0ada41012aa HTTP/1.1 May 12 11:52:19.798603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:52:19.798603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:52:19.798603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:52:19.798603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 0 May 12 11:52:19.798603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:52:19.798603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:52:19.798603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:52:19.798603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:52:19.798603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPTw2hFApQTr7ioDY1YCVRdRT1Yzh0-z3Xj4c99jhqwkN_fcNBduWooFgfuZO1GwiXY7bq8cfrWDXALszIFc7nFS2sOW0ri6MGhUezImzp3tQqWj3pO_9c3z-a00EKa6fxC1Zw_eF_ltSI1vZ87OunIVCl_ngEaHxysAMJuo-l23b8s May 12 11:52:19.798603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:52:19.798603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:52:19.798603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:52:19.798603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:52:19.798603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:52:19.798603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:52:19.798603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: 538441ae9b63481b8c22ddeb6570f175 May 12 11:52:19.798603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-VolumesGetTestJSON-1040259155 May 12 11:52:19.798603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:52:19.798603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:52:19.800177 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/538441ae9b63481b8c22ddeb6570f175"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/538441ae9b63481b8c22ddeb6570f175"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/538441ae9b63481b8c22ddeb6570f175"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_538441ae9b63481b8c22ddeb6570f175", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:52:19.800177 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-VolumesGetTestJSON-1040259155 May 12 11:52:19.800177 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: 538441ae9b63481b8c22ddeb6570f175 May 12 11:52:19.800177 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-VolumesGetTestJSON-1040259155 May 12 11:52:19.800177 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-VolumesGetTestJSON-1040259155-project May 12 11:52:19.800177 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:52:19.800177 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:52:19.800177 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: 03e97d749f634d7ca1b8c9e9eadbd2d6 May 12 11:52:19.800177 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-VolumesGetTestJSON-1040259155-project May 12 11:52:19.800177 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: May 12 11:52:19.800177 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Volume 5189255d-e216-4994-b802-a0ada41012aa could not be found. May 12 11:52:19.800177 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'id': '5189255d-e216-4994-b802-a0ada41012aa'} May 12 11:52:19.800177 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:52:19.801066 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:19.801066 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 11:52:19.801066 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 11:52:19.801066 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 11:52:19.801066 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 11:52:19.801066 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 11:52:19.801066 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 11:52:19.801066 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 11:52:19.801066 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 11:52:19.801066 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 11:52:19.801066 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 11:52:19.801066 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 11:52:19.801066 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 11:52:19.801066 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 11:52:19.801066 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 11:52:19.801066 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5189255d-e216-4994-b802-a0ada41012aa could not be found. (HTTP 404) (Request-ID: req-63c7a1b5-d3d4-4c19-b369-ee952b1fabd0) May 12 11:52:19.801066 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:19.801066 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:52:19.801066 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:19.802581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:19.802581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 11:52:19.802581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 11:52:19.802581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 11:52:19.802581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 11:52:19.802581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 11:52:19.802581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 11:52:19.802581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 11:52:19.802581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 11:52:19.802581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 11:52:19.802581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 11:52:19.802581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 11:52:19.802581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 11:52:19.802581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 11:52:19.802581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 11:52:19.802581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 11:52:19.802581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 11:52:19.802581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 11:52:19.802581 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 11:52:19.804035 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 11:52:19.804035 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 11:52:19.804035 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 11:52:19.804035 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 11:52:19.804035 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5189255d-e216-4994-b802-a0ada41012aa could not be found. May 12 11:52:19.804035 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:19.804035 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:52:19.804035 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:19.804035 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:19.804035 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:52:19.804035 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:52:19.804035 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:52:19.804035 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:52:19.804035 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 11:52:19.804035 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 11:52:19.804035 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:52:19.804035 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:52:19.804035 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 11:52:19.804035 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:52:19.805407 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5189255d-e216-4994-b802-a0ada41012aa could not be found. May 12 11:52:19.805407 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:19.805407 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:52:19.805407 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:19.805407 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:52:19.805407 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:52:19.805407 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:52:19.805407 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:52:19.805407 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:52:19.805407 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5189255d-e216-4994-b802-a0ada41012aa could not be found. May 12 11:52:19.805407 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:52:19.805407 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-7d5952e6-43bf-4afc-8de6-62cf95897f83 tempest-VolumesGetTestJSON-1040259155 tempest-VolumesGetTestJSON-1040259155-project] Returning 404 to user: Volume 5189255d-e216-4994-b802-a0ada41012aa could not be found. {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:52:19.805407 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-7d5952e6-43bf-4afc-8de6-62cf95897f83 tempest-VolumesGetTestJSON-1040259155 tempest-VolumesGetTestJSON-1040259155-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/5189255d-e216-4994-b802-a0ada41012aa" status: 404 len: 109 microversion: 2.1 time: 0.035772 May 12 11:52:19.805407 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 420/844] 10.222.0.58 () {58 vars in 1244 bytes} [Thu May 12 11:52:19 2022] GET /compute/v2.1/os-volumes/5189255d-e216-4994-b802-a0ada41012aa => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:52:28.468828 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-9386d060-e38b-47bf-ba3c-70c3d4888fb8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Action: 'create', calling method: .version_select at 0x7f29f23e2c10>, body: {"keypair": {"name": "tempest-keypair-139823241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5Z+vkJWCWM9CZX2of1guiFq4+nv1Caq4fsW7RmxboOUx4VXjPBcpx6inWE5YLccuLWGi4FTov8plzqXLe2R54NY9IlAinwJir58oyyd/7xRkvO2D0mUX2hFmyVfAP46w=="}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:52:28.483257 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-9386d060-e38b-47bf-ba3c-70c3d4888fb8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Getting quotas for project b284fcbfe0214240a616a6d68cedfed2. Resources: {'key_pairs'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:52:28.487362 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-9386d060-e38b-47bf-ba3c-70c3d4888fb8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Getting quotas for user 61fcd9d503734952b0ea9ec6ef96be6c and project b284fcbfe0214240a616a6d68cedfed2. Resources: {'key_pairs'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:52:28.517915 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-9386d060-e38b-47bf-ba3c-70c3d4888fb8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.181334 May 12 11:52:28.518844 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 425/845] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 12 11:52:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:52:30.017469 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-449d2408-affd-4329-81bf-98a37d43a25d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1676125048", "imageRef": "576e8b7b-771b-47aa-89c6-ff04accc9bea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b35a8e2-7cac-4312-8515-92a011fa862b"}], "security_groups": [{"name": "tempest-securitygroup--958462215"}], "key_name": "tempest-keypair-139823241", "user_data": "}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:52:30.143651 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.network.neutron [None req-449d2408-affd-4329-81bf-98a37d43a25d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] validate_networks() for [('7b35a8e2-7cac-4312-8515-92a011fa862b', None, None, None, None, None)] {{(pid=123507) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 11:52:30.655328 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-449d2408-affd-4329-81bf-98a37d43a25d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Flavor limits 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 11:52:30.655765 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-449d2408-affd-4329-81bf-98a37d43a25d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Image limits 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 11:52:30.656756 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-449d2408-affd-4329-81bf-98a37d43a25d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Flavor pref 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 11:52:30.656964 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-449d2408-affd-4329-81bf-98a37d43a25d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Image pref 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 11:52:30.657566 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-449d2408-affd-4329-81bf-98a37d43a25d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 11:52:30.668693 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-449d2408-affd-4329-81bf-98a37d43a25d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:30.669237 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-449d2408-affd-4329-81bf-98a37d43a25d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:30.670503 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-449d2408-affd-4329-81bf-98a37d43a25d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:30.670877 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-449d2408-affd-4329-81bf-98a37d43a25d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:30.689348 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-449d2408-affd-4329-81bf-98a37d43a25d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Getting quotas for project b284fcbfe0214240a616a6d68cedfed2. Resources: {'ram', 'cores', 'instances'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:52:30.693427 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-449d2408-affd-4329-81bf-98a37d43a25d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Getting quotas for user 61fcd9d503734952b0ea9ec6ef96be6c and project b284fcbfe0214240a616a6d68cedfed2. Resources: {'ram', 'cores', 'instances'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:52:30.704923 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-449d2408-affd-4329-81bf-98a37d43a25d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Going to run 1 instances... {{(pid=123507) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 11:52:30.707317 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-449d2408-affd-4329-81bf-98a37d43a25d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='576e8b7b-771b-47aa-89c6-ff04accc9bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123507) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 11:52:30.758949 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-449d2408-affd-4329-81bf-98a37d43a25d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.749979 May 12 11:52:30.759785 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 421/846] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 12 11:52:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 11:52:30.778318 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-277a9919-0dfb-46d8-8438-6999a7737282 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:30.778930 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-277a9919-0dfb-46d8-8438-6999a7737282 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:30.864406 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-277a9919-0dfb-46d8-8438-6999a7737282 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:30.875176 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-277a9919-0dfb-46d8-8438-6999a7737282 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a" status: 200 len: 1241 microversion: 2.1 time: 0.108073 May 12 11:52:30.876046 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 426/847] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:52:30 2022] GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:52:31.892464 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-bf9915ba-d5c8-4b65-a208-f5f6f368f721 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:31.893637 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-bf9915ba-d5c8-4b65-a208-f5f6f368f721 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:31.908267 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bf9915ba-d5c8-4b65-a208-f5f6f368f721 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:31.908520 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bf9915ba-d5c8-4b65-a208-f5f6f368f721 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:31.909977 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bf9915ba-d5c8-4b65-a208-f5f6f368f721 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:31.910590 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bf9915ba-d5c8-4b65-a208-f5f6f368f721 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:31.997393 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-bf9915ba-d5c8-4b65-a208-f5f6f368f721 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:32.006152 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-bf9915ba-d5c8-4b65-a208-f5f6f368f721 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a" status: 200 len: 1301 microversion: 2.1 time: 0.117863 May 12 11:52:32.006877 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 422/848] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:52:31 2022] GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a => generated 1301 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:52:33.024379 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-d4f9a179-2fa9-495c-9835-7551d13dd7d8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:33.026282 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d4f9a179-2fa9-495c-9835-7551d13dd7d8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:33.034557 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d4f9a179-2fa9-495c-9835-7551d13dd7d8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:33.035492 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d4f9a179-2fa9-495c-9835-7551d13dd7d8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:33.036549 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d4f9a179-2fa9-495c-9835-7551d13dd7d8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:33.037176 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d4f9a179-2fa9-495c-9835-7551d13dd7d8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:33.211370 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-d4f9a179-2fa9-495c-9835-7551d13dd7d8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:33.219631 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-d4f9a179-2fa9-495c-9835-7551d13dd7d8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a" status: 200 len: 1366 microversion: 2.1 time: 0.199486 May 12 11:52:33.229521 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 427/849] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:52:33 2022] GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:52:33.611363 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-afa6b2cf-847b-4353-9d44-407897c24fdf req-a5ecdf64-f013-4ed1-8438-9020fbdbca2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "401ebf5c-6096-418a-b3bd-8e987ed84f6a", "tag": "214a8d47-81ba-42fa-93f3-810b85245b45"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:52:33.627353 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-afa6b2cf-847b-4353-9d44-407897c24fdf req-a5ecdf64-f013-4ed1-8438-9020fbdbca2e service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:33.628037 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-afa6b2cf-847b-4353-9d44-407897c24fdf req-a5ecdf64-f013-4ed1-8438-9020fbdbca2e service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:33.642246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-afa6b2cf-847b-4353-9d44-407897c24fdf req-a5ecdf64-f013-4ed1-8438-9020fbdbca2e service nova] Creating event network-changed:214a8d47-81ba-42fa-93f3-810b85245b45 for instance 401ebf5c-6096-418a-b3bd-8e987ed84f6a on hv-cinder-80473 May 12 11:52:33.651518 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-afa6b2cf-847b-4353-9d44-407897c24fdf req-a5ecdf64-f013-4ed1-8438-9020fbdbca2e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043144 May 12 11:52:33.652406 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 423/850] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:52:34.236186 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b36315c7-06b7-42eb-9a74-0096fa89b527 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:34.236797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-b36315c7-06b7-42eb-9a74-0096fa89b527 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:34.243061 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b36315c7-06b7-42eb-9a74-0096fa89b527 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:34.243515 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b36315c7-06b7-42eb-9a74-0096fa89b527 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:34.244286 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b36315c7-06b7-42eb-9a74-0096fa89b527 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:34.245400 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b36315c7-06b7-42eb-9a74-0096fa89b527 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:34.386499 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b36315c7-06b7-42eb-9a74-0096fa89b527 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:34.393615 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-b36315c7-06b7-42eb-9a74-0096fa89b527 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a" status: 200 len: 1366 microversion: 2.1 time: 0.161219 May 12 11:52:34.394206 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 428/851] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:52:34 2022] GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:52:35.411434 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-1f711217-d0b4-43ae-84ad-e58b52bc905c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:35.412125 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-1f711217-d0b4-43ae-84ad-e58b52bc905c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:35.418167 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1f711217-d0b4-43ae-84ad-e58b52bc905c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:35.418616 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1f711217-d0b4-43ae-84ad-e58b52bc905c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:35.419371 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1f711217-d0b4-43ae-84ad-e58b52bc905c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:35.419818 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1f711217-d0b4-43ae-84ad-e58b52bc905c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:35.545075 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-1f711217-d0b4-43ae-84ad-e58b52bc905c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:35.552143 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-1f711217-d0b4-43ae-84ad-e58b52bc905c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a" status: 200 len: 1366 microversion: 2.1 time: 0.145283 May 12 11:52:35.552709 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 424/852] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:52:35 2022] GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:52:36.569135 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-4d3df6fa-34bb-40e0-ba57-d33b07e891ff tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:36.569761 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-4d3df6fa-34bb-40e0-ba57-d33b07e891ff tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:36.576622 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4d3df6fa-34bb-40e0-ba57-d33b07e891ff tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:36.577079 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4d3df6fa-34bb-40e0-ba57-d33b07e891ff tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:36.577885 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4d3df6fa-34bb-40e0-ba57-d33b07e891ff tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:36.578321 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4d3df6fa-34bb-40e0-ba57-d33b07e891ff tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:36.703370 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-4d3df6fa-34bb-40e0-ba57-d33b07e891ff tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:36.710869 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-4d3df6fa-34bb-40e0-ba57-d33b07e891ff tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a" status: 200 len: 1366 microversion: 2.1 time: 0.145626 May 12 11:52:36.711424 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 429/853] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:52:36 2022] GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:52:37.731204 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-888f6645-2c0b-4a29-a17a-3e5753deb214 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:37.731819 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-888f6645-2c0b-4a29-a17a-3e5753deb214 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:37.738746 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-888f6645-2c0b-4a29-a17a-3e5753deb214 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:37.739593 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-888f6645-2c0b-4a29-a17a-3e5753deb214 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:37.740462 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-888f6645-2c0b-4a29-a17a-3e5753deb214 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:37.741111 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-888f6645-2c0b-4a29-a17a-3e5753deb214 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:38.047768 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-888f6645-2c0b-4a29-a17a-3e5753deb214 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:38.056254 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-888f6645-2c0b-4a29-a17a-3e5753deb214 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a" status: 200 len: 1366 microversion: 2.1 time: 0.329344 May 12 11:52:38.057090 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 425/854] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:52:37 2022] GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:52:39.074185 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-42087e0d-d4c7-4038-a7c9-7e007c661ff3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:39.074796 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-42087e0d-d4c7-4038-a7c9-7e007c661ff3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:39.081279 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-42087e0d-d4c7-4038-a7c9-7e007c661ff3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:39.081762 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-42087e0d-d4c7-4038-a7c9-7e007c661ff3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:39.082537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-42087e0d-d4c7-4038-a7c9-7e007c661ff3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:39.082975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-42087e0d-d4c7-4038-a7c9-7e007c661ff3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:39.217314 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-42087e0d-d4c7-4038-a7c9-7e007c661ff3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:39.224661 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-42087e0d-d4c7-4038-a7c9-7e007c661ff3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a" status: 200 len: 1366 microversion: 2.1 time: 0.154861 May 12 11:52:39.225161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 430/855] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:52:39 2022] GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:52:40.240451 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-197f3d74-cc24-4e79-8677-9688f40e9f3e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:40.241067 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-197f3d74-cc24-4e79-8677-9688f40e9f3e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:40.247323 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-197f3d74-cc24-4e79-8677-9688f40e9f3e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:40.247776 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-197f3d74-cc24-4e79-8677-9688f40e9f3e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:40.248555 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-197f3d74-cc24-4e79-8677-9688f40e9f3e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:40.248995 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-197f3d74-cc24-4e79-8677-9688f40e9f3e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:40.378389 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-197f3d74-cc24-4e79-8677-9688f40e9f3e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:40.391266 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-197f3d74-cc24-4e79-8677-9688f40e9f3e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a" status: 200 len: 1366 microversion: 2.1 time: 0.154548 May 12 11:52:40.392086 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 426/856] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:52:40 2022] GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:52:40.546808 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-798964e6-d3fd-4d4e-9956-1ad776f14da5 req-04053cf0-f046-4e6e-a7d2-a9c99c1d9ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401ebf5c-6096-418a-b3bd-8e987ed84f6a", "name": "network-vif-plugged", "status": "completed", "tag": "214a8d47-81ba-42fa-93f3-810b85245b45"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:52:40.555751 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-798964e6-d3fd-4d4e-9956-1ad776f14da5 req-04053cf0-f046-4e6e-a7d2-a9c99c1d9ed3 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:40.556485 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-798964e6-d3fd-4d4e-9956-1ad776f14da5 req-04053cf0-f046-4e6e-a7d2-a9c99c1d9ed3 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:40.569272 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-798964e6-d3fd-4d4e-9956-1ad776f14da5 req-04053cf0-f046-4e6e-a7d2-a9c99c1d9ed3 service nova] Creating event network-vif-plugged:214a8d47-81ba-42fa-93f3-810b85245b45 for instance 401ebf5c-6096-418a-b3bd-8e987ed84f6a on hv-cinder-80473 May 12 11:52:40.574568 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-798964e6-d3fd-4d4e-9956-1ad776f14da5 req-04053cf0-f046-4e6e-a7d2-a9c99c1d9ed3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031344 May 12 11:52:40.575200 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 431/857] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:52:41.407769 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-571ec9d3-9498-4252-b238-e829201b825b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:41.408403 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-571ec9d3-9498-4252-b238-e829201b825b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:41.414648 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-571ec9d3-9498-4252-b238-e829201b825b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:41.415089 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-571ec9d3-9498-4252-b238-e829201b825b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:41.415848 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-571ec9d3-9498-4252-b238-e829201b825b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:41.416275 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-571ec9d3-9498-4252-b238-e829201b825b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:41.550137 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-571ec9d3-9498-4252-b238-e829201b825b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:41.557996 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-571ec9d3-9498-4252-b238-e829201b825b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a" status: 200 len: 1366 microversion: 2.1 time: 0.153419 May 12 11:52:41.558562 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 427/858] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:52:41 2022] GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:52:42.576169 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a0e4aa93-b5a5-49b9-97ec-d4ce67559e4e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:42.576874 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-a0e4aa93-b5a5-49b9-97ec-d4ce67559e4e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:42.583010 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a0e4aa93-b5a5-49b9-97ec-d4ce67559e4e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:42.583460 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a0e4aa93-b5a5-49b9-97ec-d4ce67559e4e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:42.584489 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a0e4aa93-b5a5-49b9-97ec-d4ce67559e4e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:42.584929 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a0e4aa93-b5a5-49b9-97ec-d4ce67559e4e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:42.710282 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-a0e4aa93-b5a5-49b9-97ec-d4ce67559e4e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:42.717738 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-a0e4aa93-b5a5-49b9-97ec-d4ce67559e4e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a" status: 200 len: 1557 microversion: 2.1 time: 0.146679 May 12 11:52:42.718245 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 432/859] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:52:42 2022] GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:52:42.733595 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-905428ab-6a30-4066-98dc-3240da27e016 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:42.734109 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-905428ab-6a30-4066-98dc-3240da27e016 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:42.740368 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-905428ab-6a30-4066-98dc-3240da27e016 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:42.740809 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-905428ab-6a30-4066-98dc-3240da27e016 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:42.741562 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-905428ab-6a30-4066-98dc-3240da27e016 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:42.742020 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-905428ab-6a30-4066-98dc-3240da27e016 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:42.820513 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-905428ab-6a30-4066-98dc-3240da27e016 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090649 May 12 11:52:42.821101 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 428/860] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 12 11:52:42 2022] GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:52:43.783816 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-3ed871b2-2b57-4094-a55e-c8107a9e1dfb req-3fb41053-0eb1-4158-bf42-0ccdc222f171 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "401ebf5c-6096-418a-b3bd-8e987ed84f6a", "tag": "214a8d47-81ba-42fa-93f3-810b85245b45"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:52:43.792485 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-3ed871b2-2b57-4094-a55e-c8107a9e1dfb req-3fb41053-0eb1-4158-bf42-0ccdc222f171 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:43.793047 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-3ed871b2-2b57-4094-a55e-c8107a9e1dfb req-3fb41053-0eb1-4158-bf42-0ccdc222f171 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:43.804409 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-3ed871b2-2b57-4094-a55e-c8107a9e1dfb req-3fb41053-0eb1-4158-bf42-0ccdc222f171 service nova] Creating event network-changed:214a8d47-81ba-42fa-93f3-810b85245b45 for instance 401ebf5c-6096-418a-b3bd-8e987ed84f6a on hv-cinder-80473 May 12 11:52:43.809591 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-3ed871b2-2b57-4094-a55e-c8107a9e1dfb req-3fb41053-0eb1-4158-bf42-0ccdc222f171 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029349 May 12 11:52:43.810258 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 433/861] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:52:53.072588 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-7d1be341-5874-494d-b4f2-14004f0a7854 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:52:53.073170 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-7d1be341-5874-494d-b4f2-14004f0a7854 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:53.079211 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7d1be341-5874-494d-b4f2-14004f0a7854 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:53.079656 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7d1be341-5874-494d-b4f2-14004f0a7854 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:53.080420 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7d1be341-5874-494d-b4f2-14004f0a7854 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:53.080854 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7d1be341-5874-494d-b4f2-14004f0a7854 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:53.106626 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.objects.instance [None req-7d1be341-5874-494d-b4f2-14004f0a7854 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lazy-loading 'flavor' on Instance uuid 8d747a75-e74d-4c41-9707-aee578ce2d01 {{(pid=123507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:52:53.179993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-7d1be341-5874-494d-b4f2-14004f0a7854 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "POST /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01/action" status: 202 len: 0 microversion: 2.1 time: 0.112346 May 12 11:52:53.180586 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 429/862] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 12 11:52:53 2022] POST /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:52:53.193478 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-791143b9-44e7-4fd7-bb19-b05c5f087367 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:53.194189 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-791143b9-44e7-4fd7-bb19-b05c5f087367 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:53.201896 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-791143b9-44e7-4fd7-bb19-b05c5f087367 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:53.202352 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-791143b9-44e7-4fd7-bb19-b05c5f087367 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:53.203139 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-791143b9-44e7-4fd7-bb19-b05c5f087367 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:53.203582 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-791143b9-44e7-4fd7-bb19-b05c5f087367 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:53.341965 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-791143b9-44e7-4fd7-bb19-b05c5f087367 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:53.349233 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-791143b9-44e7-4fd7-bb19-b05c5f087367 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1568 microversion: 2.1 time: 0.160469 May 12 11:52:53.349825 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 434/863] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:52:53 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:52:54.367508 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-b68d482c-88ed-451c-945c-96fd299d6a42 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:54.368204 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-b68d482c-88ed-451c-945c-96fd299d6a42 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:54.375287 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b68d482c-88ed-451c-945c-96fd299d6a42 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:54.375734 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b68d482c-88ed-451c-945c-96fd299d6a42 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:54.376493 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b68d482c-88ed-451c-945c-96fd299d6a42 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:54.376927 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b68d482c-88ed-451c-945c-96fd299d6a42 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:54.510545 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b68d482c-88ed-451c-945c-96fd299d6a42 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:54.517751 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-b68d482c-88ed-451c-945c-96fd299d6a42 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1568 microversion: 2.1 time: 0.154426 May 12 11:52:54.518314 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 430/864] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:52:54 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:52:55.534571 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-dce0f443-b3c8-48d6-b714-8b7c04628b6f tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:55.535180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-dce0f443-b3c8-48d6-b714-8b7c04628b6f tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:55.541477 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dce0f443-b3c8-48d6-b714-8b7c04628b6f tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:55.541956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dce0f443-b3c8-48d6-b714-8b7c04628b6f tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:55.542725 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dce0f443-b3c8-48d6-b714-8b7c04628b6f tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:55.543164 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-dce0f443-b3c8-48d6-b714-8b7c04628b6f tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:55.674134 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-dce0f443-b3c8-48d6-b714-8b7c04628b6f tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:55.681321 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-dce0f443-b3c8-48d6-b714-8b7c04628b6f tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1568 microversion: 2.1 time: 0.150595 May 12 11:52:55.681917 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 435/865] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:52:55 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:52:56.698575 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-ccaff753-2c9c-4074-9298-5892fb2cdf83 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:56.699108 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-ccaff753-2c9c-4074-9298-5892fb2cdf83 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:56.705866 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ccaff753-2c9c-4074-9298-5892fb2cdf83 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:56.706312 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ccaff753-2c9c-4074-9298-5892fb2cdf83 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:56.707060 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ccaff753-2c9c-4074-9298-5892fb2cdf83 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:56.707489 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ccaff753-2c9c-4074-9298-5892fb2cdf83 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:56.832767 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-ccaff753-2c9c-4074-9298-5892fb2cdf83 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:56.841052 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-ccaff753-2c9c-4074-9298-5892fb2cdf83 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1568 microversion: 2.1 time: 0.145743 May 12 11:52:56.841880 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 431/866] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:52:56 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:52:57.857770 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-8cb33dd3-15fd-4737-9b90-2462a15cbb50 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:57.858296 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-8cb33dd3-15fd-4737-9b90-2462a15cbb50 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:57.864585 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8cb33dd3-15fd-4737-9b90-2462a15cbb50 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:57.865027 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8cb33dd3-15fd-4737-9b90-2462a15cbb50 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:57.865801 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8cb33dd3-15fd-4737-9b90-2462a15cbb50 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:57.866234 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8cb33dd3-15fd-4737-9b90-2462a15cbb50 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:57.991574 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8cb33dd3-15fd-4737-9b90-2462a15cbb50 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:57.999333 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-8cb33dd3-15fd-4737-9b90-2462a15cbb50 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1568 microversion: 2.1 time: 0.145455 May 12 11:52:57.999901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 436/867] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:52:57 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:52:59.015797 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-fcaab058-9700-4af6-b952-3952deea05dd tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:52:59.016413 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-fcaab058-9700-4af6-b952-3952deea05dd tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:52:59.022788 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fcaab058-9700-4af6-b952-3952deea05dd tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:59.023244 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fcaab058-9700-4af6-b952-3952deea05dd tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:59.024171 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fcaab058-9700-4af6-b952-3952deea05dd tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:52:59.024679 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fcaab058-9700-4af6-b952-3952deea05dd tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:52:59.153490 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-fcaab058-9700-4af6-b952-3952deea05dd tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:52:59.160958 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-fcaab058-9700-4af6-b952-3952deea05dd tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1568 microversion: 2.1 time: 0.149524 May 12 11:52:59.161525 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 432/868] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:52:59 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:00.177499 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-c3cf4fd3-c606-45ca-8cdf-20f9fdb1e9ce tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:00.178135 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-c3cf4fd3-c606-45ca-8cdf-20f9fdb1e9ce tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:00.184983 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c3cf4fd3-c606-45ca-8cdf-20f9fdb1e9ce tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:00.185447 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c3cf4fd3-c606-45ca-8cdf-20f9fdb1e9ce tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:00.186322 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c3cf4fd3-c606-45ca-8cdf-20f9fdb1e9ce tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:00.186799 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c3cf4fd3-c606-45ca-8cdf-20f9fdb1e9ce tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:00.316736 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c3cf4fd3-c606-45ca-8cdf-20f9fdb1e9ce tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:00.324016 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-c3cf4fd3-c606-45ca-8cdf-20f9fdb1e9ce tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1568 microversion: 2.1 time: 0.150427 May 12 11:53:00.324583 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 437/869] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:00 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:01.340576 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-7287dbe2-bc77-4af6-a4cd-cf743b977f84 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:01.341235 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-7287dbe2-bc77-4af6-a4cd-cf743b977f84 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:01.347624 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7287dbe2-bc77-4af6-a4cd-cf743b977f84 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:01.348075 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7287dbe2-bc77-4af6-a4cd-cf743b977f84 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:01.348875 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7287dbe2-bc77-4af6-a4cd-cf743b977f84 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:01.349311 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7287dbe2-bc77-4af6-a4cd-cf743b977f84 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:01.476866 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-7287dbe2-bc77-4af6-a4cd-cf743b977f84 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:01.484836 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-7287dbe2-bc77-4af6-a4cd-cf743b977f84 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1568 microversion: 2.1 time: 0.148205 May 12 11:53:01.485393 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 433/870] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:01 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:02.501192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-33528e64-f7e4-4d6f-a8b3-e0a19cfc464c tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:02.501874 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-33528e64-f7e4-4d6f-a8b3-e0a19cfc464c tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:02.507823 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-33528e64-f7e4-4d6f-a8b3-e0a19cfc464c tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:02.508271 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-33528e64-f7e4-4d6f-a8b3-e0a19cfc464c tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:02.509042 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-33528e64-f7e4-4d6f-a8b3-e0a19cfc464c tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:02.509477 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-33528e64-f7e4-4d6f-a8b3-e0a19cfc464c tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:02.638296 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-33528e64-f7e4-4d6f-a8b3-e0a19cfc464c tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:02.645529 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-33528e64-f7e4-4d6f-a8b3-e0a19cfc464c tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1568 microversion: 2.1 time: 0.148094 May 12 11:53:02.646179 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 438/871] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:02 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:53:03.663561 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-b09a278f-8549-4760-8cce-42598d51d5ea tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:03.664170 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-b09a278f-8549-4760-8cce-42598d51d5ea tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:03.670458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b09a278f-8549-4760-8cce-42598d51d5ea tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:03.670904 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b09a278f-8549-4760-8cce-42598d51d5ea tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:03.671666 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b09a278f-8549-4760-8cce-42598d51d5ea tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:03.672103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b09a278f-8549-4760-8cce-42598d51d5ea tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:03.864979 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b09a278f-8549-4760-8cce-42598d51d5ea tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:03.872668 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-b09a278f-8549-4760-8cce-42598d51d5ea tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1568 microversion: 2.1 time: 0.213000 May 12 11:53:03.873430 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 434/872] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:03 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1568 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:04.890542 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-5918cca7-38f4-4c93-9340-1737764b4b1b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:04.891087 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-5918cca7-38f4-4c93-9340-1737764b4b1b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:04.897405 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5918cca7-38f4-4c93-9340-1737764b4b1b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:04.897879 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5918cca7-38f4-4c93-9340-1737764b4b1b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:04.898643 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5918cca7-38f4-4c93-9340-1737764b4b1b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:04.899864 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5918cca7-38f4-4c93-9340-1737764b4b1b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:05.029562 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-5918cca7-38f4-4c93-9340-1737764b4b1b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:05.036851 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-5918cca7-38f4-4c93-9340-1737764b4b1b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1568 microversion: 2.1 time: 0.151049 May 12 11:53:05.037536 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 439/873] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:04 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:06.054421 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-468945f5-b3f6-4aa2-b8c9-94bf8fb5d203 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:06.055018 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-468945f5-b3f6-4aa2-b8c9-94bf8fb5d203 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:06.060890 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-468945f5-b3f6-4aa2-b8c9-94bf8fb5d203 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:06.061416 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-468945f5-b3f6-4aa2-b8c9-94bf8fb5d203 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:06.062294 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-468945f5-b3f6-4aa2-b8c9-94bf8fb5d203 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:06.062911 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-468945f5-b3f6-4aa2-b8c9-94bf8fb5d203 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:06.205385 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-468945f5-b3f6-4aa2-b8c9-94bf8fb5d203 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:06.213078 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-468945f5-b3f6-4aa2-b8c9-94bf8fb5d203 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1568 microversion: 2.1 time: 0.162917 May 12 11:53:06.213588 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 435/874] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:06 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:07.229811 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-9d4e5c7f-5cec-4ffe-a016-ae1457389531 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:07.230425 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-9d4e5c7f-5cec-4ffe-a016-ae1457389531 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:07.237403 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9d4e5c7f-5cec-4ffe-a016-ae1457389531 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:07.237839 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9d4e5c7f-5cec-4ffe-a016-ae1457389531 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:07.238614 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9d4e5c7f-5cec-4ffe-a016-ae1457389531 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:07.239091 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9d4e5c7f-5cec-4ffe-a016-ae1457389531 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:07.367997 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-9d4e5c7f-5cec-4ffe-a016-ae1457389531 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:07.375908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-9d4e5c7f-5cec-4ffe-a016-ae1457389531 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1509 microversion: 2.1 time: 0.149977 May 12 11:53:07.376483 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 440/875] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:07 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:07.391794 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-582a0bce-04c8-4b1f-879a-871667dcedde tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:53:07.392362 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-582a0bce-04c8-4b1f-879a-871667dcedde tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:07.398814 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-582a0bce-04c8-4b1f-879a-871667dcedde tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:07.399293 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-582a0bce-04c8-4b1f-879a-871667dcedde tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:07.400058 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-582a0bce-04c8-4b1f-879a-871667dcedde tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:07.400520 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-582a0bce-04c8-4b1f-879a-871667dcedde tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:07.472785 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-582a0bce-04c8-4b1f-879a-871667dcedde tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "POST /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01/action" status: 202 len: 0 microversion: 2.1 time: 0.084729 May 12 11:53:07.473407 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 436/876] 10.222.0.58 () {60 vars in 1277 bytes} [Thu May 12 11:53:07 2022] POST /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:53:07.482082 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-24897a1c-aeaa-44bb-ab73-f355815c0648 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:07.482699 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-24897a1c-aeaa-44bb-ab73-f355815c0648 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:07.488642 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-24897a1c-aeaa-44bb-ab73-f355815c0648 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:07.489037 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-24897a1c-aeaa-44bb-ab73-f355815c0648 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:07.489835 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-24897a1c-aeaa-44bb-ab73-f355815c0648 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:07.490279 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-24897a1c-aeaa-44bb-ab73-f355815c0648 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:07.620550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-24897a1c-aeaa-44bb-ab73-f355815c0648 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:07.627951 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-24897a1c-aeaa-44bb-ab73-f355815c0648 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1517 microversion: 2.1 time: 0.150361 May 12 11:53:07.628526 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 441/877] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:07 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:08.645129 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-c99b0ea9-b007-40c7-8d08-cbd12abb34b2 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:08.645771 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-c99b0ea9-b007-40c7-8d08-cbd12abb34b2 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:08.651850 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c99b0ea9-b007-40c7-8d08-cbd12abb34b2 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:08.652307 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c99b0ea9-b007-40c7-8d08-cbd12abb34b2 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:08.653084 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c99b0ea9-b007-40c7-8d08-cbd12abb34b2 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:08.653521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c99b0ea9-b007-40c7-8d08-cbd12abb34b2 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:08.784093 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-c99b0ea9-b007-40c7-8d08-cbd12abb34b2 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:08.791203 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-c99b0ea9-b007-40c7-8d08-cbd12abb34b2 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1519 microversion: 2.1 time: 0.150388 May 12 11:53:08.791759 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 437/878] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:08 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:09.808480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-9493c815-17fe-4dd9-8e19-b8f30412355d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:09.809033 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-9493c815-17fe-4dd9-8e19-b8f30412355d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:09.815637 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9493c815-17fe-4dd9-8e19-b8f30412355d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:09.816079 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9493c815-17fe-4dd9-8e19-b8f30412355d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:09.816857 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9493c815-17fe-4dd9-8e19-b8f30412355d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:09.817288 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9493c815-17fe-4dd9-8e19-b8f30412355d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:09.951239 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-9493c815-17fe-4dd9-8e19-b8f30412355d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:09.960003 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-9493c815-17fe-4dd9-8e19-b8f30412355d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1575 microversion: 2.1 time: 0.155459 May 12 11:53:09.960866 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 442/879] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:09 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:10.599479 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-1e41b446-c1c6-4d2d-acbc-4b803657a187 req-082e66b9-4e1a-40b4-8ade-31e5a46a9896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d747a75-e74d-4c41-9707-aee578ce2d01", "name": "network-vif-unplugged", "status": "completed", "tag": "0b817862-786a-4db4-bdba-c4efd02f2cda"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:53:10.609011 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-1e41b446-c1c6-4d2d-acbc-4b803657a187 req-082e66b9-4e1a-40b4-8ade-31e5a46a9896 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:10.609612 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-1e41b446-c1c6-4d2d-acbc-4b803657a187 req-082e66b9-4e1a-40b4-8ade-31e5a46a9896 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:10.624341 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-1e41b446-c1c6-4d2d-acbc-4b803657a187 req-082e66b9-4e1a-40b4-8ade-31e5a46a9896 service nova] Creating event network-vif-unplugged:0b817862-786a-4db4-bdba-c4efd02f2cda for instance 8d747a75-e74d-4c41-9707-aee578ce2d01 on hv-cinder-80473 May 12 11:53:10.629221 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-1e41b446-c1c6-4d2d-acbc-4b803657a187 req-082e66b9-4e1a-40b4-8ade-31e5a46a9896 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033432 May 12 11:53:10.629841 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 438/880] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:53:10.977715 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-eecd0699-f375-4485-bb5f-e956ef268926 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:10.978340 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-eecd0699-f375-4485-bb5f-e956ef268926 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:10.985076 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-eecd0699-f375-4485-bb5f-e956ef268926 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:10.985526 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-eecd0699-f375-4485-bb5f-e956ef268926 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:10.986649 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-eecd0699-f375-4485-bb5f-e956ef268926 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:10.986765 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-eecd0699-f375-4485-bb5f-e956ef268926 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:11.112278 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-eecd0699-f375-4485-bb5f-e956ef268926 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:11.119564 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-eecd0699-f375-4485-bb5f-e956ef268926 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1575 microversion: 2.1 time: 0.145716 May 12 11:53:11.120132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 443/881] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:10 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1575 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:12.138131 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-031386e2-3099-42a4-aa69-2ba917d0fb1d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:12.138823 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-031386e2-3099-42a4-aa69-2ba917d0fb1d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:12.144905 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-031386e2-3099-42a4-aa69-2ba917d0fb1d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:12.145344 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-031386e2-3099-42a4-aa69-2ba917d0fb1d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:12.146131 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-031386e2-3099-42a4-aa69-2ba917d0fb1d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:12.146562 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-031386e2-3099-42a4-aa69-2ba917d0fb1d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:12.273557 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-031386e2-3099-42a4-aa69-2ba917d0fb1d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:12.282810 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-031386e2-3099-42a4-aa69-2ba917d0fb1d tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1575 microversion: 2.1 time: 0.149305 May 12 11:53:12.283376 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 439/882] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:12 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:13.299724 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-98a803be-98ee-473a-8d28-d39d18f7c0a8 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:13.300333 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-98a803be-98ee-473a-8d28-d39d18f7c0a8 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:13.306543 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-98a803be-98ee-473a-8d28-d39d18f7c0a8 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:13.306989 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-98a803be-98ee-473a-8d28-d39d18f7c0a8 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:13.307748 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-98a803be-98ee-473a-8d28-d39d18f7c0a8 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:13.308185 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-98a803be-98ee-473a-8d28-d39d18f7c0a8 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:13.438635 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-98a803be-98ee-473a-8d28-d39d18f7c0a8 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:13.445853 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-98a803be-98ee-473a-8d28-d39d18f7c0a8 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1575 microversion: 2.1 time: 0.149914 May 12 11:53:13.446422 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 444/883] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:13 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:14.463735 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-fcd8ced1-3472-4d96-b62d-f40093b5e2c6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:14.464341 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-fcd8ced1-3472-4d96-b62d-f40093b5e2c6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:14.470658 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fcd8ced1-3472-4d96-b62d-f40093b5e2c6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:14.471107 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fcd8ced1-3472-4d96-b62d-f40093b5e2c6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:14.471870 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fcd8ced1-3472-4d96-b62d-f40093b5e2c6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:14.472305 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fcd8ced1-3472-4d96-b62d-f40093b5e2c6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:14.604779 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-fcd8ced1-3472-4d96-b62d-f40093b5e2c6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:14.612658 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-fcd8ced1-3472-4d96-b62d-f40093b5e2c6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1575 microversion: 2.1 time: 0.153042 May 12 11:53:14.613213 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 440/884] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:14 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:15.629309 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-d73e05bd-f622-4358-93a5-9372fc77b3e3 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:15.629966 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d73e05bd-f622-4358-93a5-9372fc77b3e3 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:15.636249 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d73e05bd-f622-4358-93a5-9372fc77b3e3 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:15.636692 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d73e05bd-f622-4358-93a5-9372fc77b3e3 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:15.637447 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d73e05bd-f622-4358-93a5-9372fc77b3e3 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:15.637910 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d73e05bd-f622-4358-93a5-9372fc77b3e3 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:15.765556 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-d73e05bd-f622-4358-93a5-9372fc77b3e3 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:15.772809 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-d73e05bd-f622-4358-93a5-9372fc77b3e3 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1575 microversion: 2.1 time: 0.147341 May 12 11:53:15.773380 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 445/885] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:15 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:16.790475 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-2dd2947d-7fba-45ed-afec-0f7f600cfc2b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:16.791014 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-2dd2947d-7fba-45ed-afec-0f7f600cfc2b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:16.797350 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2dd2947d-7fba-45ed-afec-0f7f600cfc2b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:16.797839 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2dd2947d-7fba-45ed-afec-0f7f600cfc2b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:16.798609 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2dd2947d-7fba-45ed-afec-0f7f600cfc2b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:16.799045 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2dd2947d-7fba-45ed-afec-0f7f600cfc2b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:16.932552 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-2dd2947d-7fba-45ed-afec-0f7f600cfc2b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:16.939868 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-2dd2947d-7fba-45ed-afec-0f7f600cfc2b tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1575 microversion: 2.1 time: 0.153315 May 12 11:53:16.940431 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 441/886] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:16 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:17.957259 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-fe701a6e-cee3-4eca-b6e8-68a1b7e98ccb tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:17.957829 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-fe701a6e-cee3-4eca-b6e8-68a1b7e98ccb tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:17.964442 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fe701a6e-cee3-4eca-b6e8-68a1b7e98ccb tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:17.964897 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fe701a6e-cee3-4eca-b6e8-68a1b7e98ccb tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:17.965668 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fe701a6e-cee3-4eca-b6e8-68a1b7e98ccb tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:17.966133 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fe701a6e-cee3-4eca-b6e8-68a1b7e98ccb tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:18.094861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-fe701a6e-cee3-4eca-b6e8-68a1b7e98ccb tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:18.102127 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-fe701a6e-cee3-4eca-b6e8-68a1b7e98ccb tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1562 microversion: 2.1 time: 0.148781 May 12 11:53:18.102701 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 446/887] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:17 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:19.636420 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-40eb09d3-c1a8-49e7-93d3-134f7e221c8e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:19.637009 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-40eb09d3-c1a8-49e7-93d3-134f7e221c8e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:19.643904 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-40eb09d3-c1a8-49e7-93d3-134f7e221c8e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:19.644353 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-40eb09d3-c1a8-49e7-93d3-134f7e221c8e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:19.645125 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-40eb09d3-c1a8-49e7-93d3-134f7e221c8e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:19.645561 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-40eb09d3-c1a8-49e7-93d3-134f7e221c8e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:19.667222 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-40eb09d3-c1a8-49e7-93d3-134f7e221c8e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a/ips" status: 200 len: 149 microversion: 2.1 time: 0.034695 May 12 11:53:19.667774 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 442/888] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 12 11:53:19 2022] GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:53:20.758941 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-4c3891d2-582b-4a7b-8daa-cb7838493861 req-5841defc-0c67-48e2-a197-eec31d46be70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d747a75-e74d-4c41-9707-aee578ce2d01", "name": "network-vif-plugged", "status": "completed", "tag": "0b817862-786a-4db4-bdba-c4efd02f2cda"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:53:20.767681 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-4c3891d2-582b-4a7b-8daa-cb7838493861 req-5841defc-0c67-48e2-a197-eec31d46be70 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:20.768148 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-4c3891d2-582b-4a7b-8daa-cb7838493861 req-5841defc-0c67-48e2-a197-eec31d46be70 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:20.780857 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-4c3891d2-582b-4a7b-8daa-cb7838493861 req-5841defc-0c67-48e2-a197-eec31d46be70 service nova] Creating event network-vif-plugged:0b817862-786a-4db4-bdba-c4efd02f2cda for instance 8d747a75-e74d-4c41-9707-aee578ce2d01 on hv-cinder-80473 May 12 11:53:20.785818 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-4c3891d2-582b-4a7b-8daa-cb7838493861 req-5841defc-0c67-48e2-a197-eec31d46be70 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030581 May 12 11:53:20.786405 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 447/889] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:53:20.999549 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-de22d543-2770-465f-aa9c-889a9c78edef tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e90ee792-1084-4f20-a883-da02776d1575"}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:53:21.000610 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-de22d543-2770-465f-aa9c-889a9c78edef tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:21.006994 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-de22d543-2770-465f-aa9c-889a9c78edef tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:21.007459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-de22d543-2770-465f-aa9c-889a9c78edef tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:21.008200 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-de22d543-2770-465f-aa9c-889a9c78edef tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:21.008633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-de22d543-2770-465f-aa9c-889a9c78edef tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:21.248879 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-de22d543-2770-465f-aa9c-889a9c78edef tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "POST /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253447 May 12 11:53:21.253942 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 443/890] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 12 11:53:20 2022] POST /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:53:28.723636 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-40c10bcb-7e39-4842-9f62-063a63b1972f tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Action: 'create', calling method: .version_select at 0x7f29f2581ee0>, body: {"keypair": {"name": "tempest-keypair-978292019", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpU10GDgUqOt7zdZ6jvGMQPmSt3ZmxvKjPqPNMsqPljsn2OxJyygUVP9UW0VZfb3fbP3soOl9yZRty3nZLXPczL0FebSMUUvF/aJMZNmy2lOo9Z5Tk0G6pcmp0kWcgM0g=="}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:53:28.738009 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-40c10bcb-7e39-4842-9f62-063a63b1972f tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Getting quotas for project b284fcbfe0214240a616a6d68cedfed2. Resources: {'key_pairs'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:53:28.741749 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-40c10bcb-7e39-4842-9f62-063a63b1972f tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Getting quotas for user 61fcd9d503734952b0ea9ec6ef96be6c and project b284fcbfe0214240a616a6d68cedfed2. Resources: {'key_pairs'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:53:28.763515 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-40c10bcb-7e39-4842-9f62-063a63b1972f tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043991 May 12 11:53:28.764057 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 448/891] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 12 11:53:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:53:30.021103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-d69d31cc-f831-4f17-88bd-26b13df3e040 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-680131333", "imageRef": "576e8b7b-771b-47aa-89c6-ff04accc9bea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b35a8e2-7cac-4312-8515-92a011fa862b"}], "security_groups": [{"name": "tempest-securitygroup--1200834448"}], "key_name": "tempest-keypair-978292019", "user_data": "}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:53:30.119603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.network.neutron [None req-d69d31cc-f831-4f17-88bd-26b13df3e040 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] validate_networks() for [('7b35a8e2-7cac-4312-8515-92a011fa862b', None, None, None, None, None)] {{(pid=123507) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 11:53:30.473577 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-d69d31cc-f831-4f17-88bd-26b13df3e040 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Flavor limits 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 11:53:30.474028 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-d69d31cc-f831-4f17-88bd-26b13df3e040 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Image limits 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 11:53:30.474498 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-d69d31cc-f831-4f17-88bd-26b13df3e040 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Flavor pref 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 11:53:30.474905 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-d69d31cc-f831-4f17-88bd-26b13df3e040 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Image pref 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 11:53:30.475334 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-d69d31cc-f831-4f17-88bd-26b13df3e040 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 11:53:30.484330 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d69d31cc-f831-4f17-88bd-26b13df3e040 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:30.484785 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d69d31cc-f831-4f17-88bd-26b13df3e040 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:30.485779 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d69d31cc-f831-4f17-88bd-26b13df3e040 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:30.486395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d69d31cc-f831-4f17-88bd-26b13df3e040 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:30.503922 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-d69d31cc-f831-4f17-88bd-26b13df3e040 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Getting quotas for project b284fcbfe0214240a616a6d68cedfed2. Resources: {'ram', 'cores', 'instances'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:53:30.507482 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-d69d31cc-f831-4f17-88bd-26b13df3e040 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Getting quotas for user 61fcd9d503734952b0ea9ec6ef96be6c and project b284fcbfe0214240a616a6d68cedfed2. Resources: {'ram', 'cores', 'instances'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:53:30.518133 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d69d31cc-f831-4f17-88bd-26b13df3e040 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Going to run 1 instances... {{(pid=123507) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 11:53:30.520473 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d69d31cc-f831-4f17-88bd-26b13df3e040 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 2a77980d-5760-4526-a9e7-dc3f71a4a0c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='576e8b7b-771b-47aa-89c6-ff04accc9bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123507) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 11:53:30.565242 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-d69d31cc-f831-4f17-88bd-26b13df3e040 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.549111 May 12 11:53:30.566098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 444/892] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 12 11:53:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 11:53:30.575719 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-60013762-3217-4bf8-8cfe-f4ab1bcd3c87 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:30.576450 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-60013762-3217-4bf8-8cfe-f4ab1bcd3c87 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 2a77980d-5760-4526-a9e7-dc3f71a4a0c0] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:30.630785 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-60013762-3217-4bf8-8cfe-f4ab1bcd3c87 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:30.637277 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-60013762-3217-4bf8-8cfe-f4ab1bcd3c87 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0" status: 200 len: 1240 microversion: 2.1 time: 0.065462 May 12 11:53:30.638216 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 449/893] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:30 2022] GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0 => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:31.654316 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-d25142c1-e429-4116-b4f1-e0d375c7f92c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:31.654951 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d25142c1-e429-4116-b4f1-e0d375c7f92c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 2a77980d-5760-4526-a9e7-dc3f71a4a0c0] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:31.663226 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d25142c1-e429-4116-b4f1-e0d375c7f92c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:31.663755 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d25142c1-e429-4116-b4f1-e0d375c7f92c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:31.664529 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d25142c1-e429-4116-b4f1-e0d375c7f92c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:31.665172 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d25142c1-e429-4116-b4f1-e0d375c7f92c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:31.733446 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-d25142c1-e429-4116-b4f1-e0d375c7f92c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:31.740626 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-d25142c1-e429-4116-b4f1-e0d375c7f92c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0" status: 200 len: 1298 microversion: 2.1 time: 0.090746 May 12 11:53:31.741191 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 445/894] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:31 2022] GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0 => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:32.757383 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-7b4ed328-7b78-4ffd-b7f6-05923eec7f6e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:32.758128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-7b4ed328-7b78-4ffd-b7f6-05923eec7f6e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 2a77980d-5760-4526-a9e7-dc3f71a4a0c0] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:32.764354 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7b4ed328-7b78-4ffd-b7f6-05923eec7f6e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:32.764797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7b4ed328-7b78-4ffd-b7f6-05923eec7f6e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:32.765565 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7b4ed328-7b78-4ffd-b7f6-05923eec7f6e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:32.766019 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7b4ed328-7b78-4ffd-b7f6-05923eec7f6e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:32.912500 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-7b4ed328-7b78-4ffd-b7f6-05923eec7f6e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:32.920490 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-7b4ed328-7b78-4ffd-b7f6-05923eec7f6e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0" status: 200 len: 1366 microversion: 2.1 time: 0.166892 May 12 11:53:32.921072 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 450/895] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:32 2022] GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:32.988789 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-14d65cd6-879d-414f-80ef-9d6a5cc97b9f req-0a2460b7-2205-4f8b-a7c8-4398b07095ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a77980d-5760-4526-a9e7-dc3f71a4a0c0", "tag": "b8ad170a-196a-4b05-b4b7-4d4cc26b5879"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:53:32.999473 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-14d65cd6-879d-414f-80ef-9d6a5cc97b9f req-0a2460b7-2205-4f8b-a7c8-4398b07095ff service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:32.999925 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-14d65cd6-879d-414f-80ef-9d6a5cc97b9f req-0a2460b7-2205-4f8b-a7c8-4398b07095ff service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:33.016768 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-14d65cd6-879d-414f-80ef-9d6a5cc97b9f req-0a2460b7-2205-4f8b-a7c8-4398b07095ff service nova] Creating event network-changed:b8ad170a-196a-4b05-b4b7-4d4cc26b5879 for instance 2a77980d-5760-4526-a9e7-dc3f71a4a0c0 on hv-cinder-80473 May 12 11:53:33.021904 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-14d65cd6-879d-414f-80ef-9d6a5cc97b9f req-0a2460b7-2205-4f8b-a7c8-4398b07095ff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038564 May 12 11:53:33.022607 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 446/896] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:53:33.937149 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-cecddcce-e631-4b74-b678-c80cfd86b0a8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:33.937664 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-cecddcce-e631-4b74-b678-c80cfd86b0a8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 2a77980d-5760-4526-a9e7-dc3f71a4a0c0] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:33.944004 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cecddcce-e631-4b74-b678-c80cfd86b0a8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:33.944452 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cecddcce-e631-4b74-b678-c80cfd86b0a8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:33.945267 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cecddcce-e631-4b74-b678-c80cfd86b0a8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:33.945777 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cecddcce-e631-4b74-b678-c80cfd86b0a8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:34.074414 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-cecddcce-e631-4b74-b678-c80cfd86b0a8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:34.087103 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-cecddcce-e631-4b74-b678-c80cfd86b0a8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0" status: 200 len: 1366 microversion: 2.1 time: 0.153882 May 12 11:53:34.087688 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 451/897] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:33 2022] GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:35.105332 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-aacd836f-31b9-4a8f-be0a-5242bd2c73b6 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:35.106056 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-aacd836f-31b9-4a8f-be0a-5242bd2c73b6 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 2a77980d-5760-4526-a9e7-dc3f71a4a0c0] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:35.112762 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-aacd836f-31b9-4a8f-be0a-5242bd2c73b6 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:35.113211 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-aacd836f-31b9-4a8f-be0a-5242bd2c73b6 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:35.114009 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-aacd836f-31b9-4a8f-be0a-5242bd2c73b6 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:35.114448 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-aacd836f-31b9-4a8f-be0a-5242bd2c73b6 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:35.246633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-aacd836f-31b9-4a8f-be0a-5242bd2c73b6 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:35.253819 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-aacd836f-31b9-4a8f-be0a-5242bd2c73b6 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0" status: 200 len: 1366 microversion: 2.1 time: 0.153041 May 12 11:53:35.254323 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 447/898] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:35 2022] GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:36.270287 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-4dcc4d34-4580-4671-85a4-94c34ea646db tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:36.270900 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-4dcc4d34-4580-4671-85a4-94c34ea646db tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 2a77980d-5760-4526-a9e7-dc3f71a4a0c0] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:36.277153 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4dcc4d34-4580-4671-85a4-94c34ea646db tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:36.277606 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4dcc4d34-4580-4671-85a4-94c34ea646db tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:36.278421 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4dcc4d34-4580-4671-85a4-94c34ea646db tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:36.278859 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4dcc4d34-4580-4671-85a4-94c34ea646db tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:36.401623 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-4dcc4d34-4580-4671-85a4-94c34ea646db tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:36.408836 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-4dcc4d34-4580-4671-85a4-94c34ea646db tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0" status: 200 len: 1366 microversion: 2.1 time: 0.142424 May 12 11:53:36.409398 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 452/899] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:36 2022] GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0 => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:37.425077 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-a913b0af-d7e0-4cff-8536-533e487907c4 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:37.425736 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-a913b0af-d7e0-4cff-8536-533e487907c4 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 2a77980d-5760-4526-a9e7-dc3f71a4a0c0] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:37.431913 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a913b0af-d7e0-4cff-8536-533e487907c4 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:37.432363 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a913b0af-d7e0-4cff-8536-533e487907c4 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:37.433129 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a913b0af-d7e0-4cff-8536-533e487907c4 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:37.433568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a913b0af-d7e0-4cff-8536-533e487907c4 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:37.557033 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-a913b0af-d7e0-4cff-8536-533e487907c4 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:37.564188 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-a913b0af-d7e0-4cff-8536-533e487907c4 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0" status: 200 len: 1366 microversion: 2.1 time: 0.143068 May 12 11:53:37.564748 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 448/900] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:37 2022] GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:38.580169 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-425c78ac-2c83-476a-b2f4-0692a1f73cd1 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:38.580779 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-425c78ac-2c83-476a-b2f4-0692a1f73cd1 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 2a77980d-5760-4526-a9e7-dc3f71a4a0c0] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:38.587339 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-425c78ac-2c83-476a-b2f4-0692a1f73cd1 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:38.587790 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-425c78ac-2c83-476a-b2f4-0692a1f73cd1 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:38.588553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-425c78ac-2c83-476a-b2f4-0692a1f73cd1 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:38.588992 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-425c78ac-2c83-476a-b2f4-0692a1f73cd1 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:38.717291 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-425c78ac-2c83-476a-b2f4-0692a1f73cd1 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:38.724529 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-425c78ac-2c83-476a-b2f4-0692a1f73cd1 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0" status: 200 len: 1366 microversion: 2.1 time: 0.148199 May 12 11:53:38.725106 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 453/901] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:38 2022] GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:38.863101 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-71f768d1-356f-4308-9817-41b5b4dbabbe req-27b98ade-be19-43b1-8bfb-9193f16edddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a77980d-5760-4526-a9e7-dc3f71a4a0c0", "name": "network-vif-plugged", "status": "completed", "tag": "b8ad170a-196a-4b05-b4b7-4d4cc26b5879"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:53:38.871727 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-71f768d1-356f-4308-9817-41b5b4dbabbe req-27b98ade-be19-43b1-8bfb-9193f16edddc service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:38.872297 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-71f768d1-356f-4308-9817-41b5b4dbabbe req-27b98ade-be19-43b1-8bfb-9193f16edddc service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:38.887053 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-71f768d1-356f-4308-9817-41b5b4dbabbe req-27b98ade-be19-43b1-8bfb-9193f16edddc service nova] Creating event network-vif-plugged:b8ad170a-196a-4b05-b4b7-4d4cc26b5879 for instance 2a77980d-5760-4526-a9e7-dc3f71a4a0c0 on hv-cinder-80473 May 12 11:53:38.891926 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-71f768d1-356f-4308-9817-41b5b4dbabbe req-27b98ade-be19-43b1-8bfb-9193f16edddc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032545 May 12 11:53:38.892519 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 449/902] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:53:39.741743 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-7bef2d14-f30e-4bbb-ab04-87f11f55e501 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:39.742356 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-7bef2d14-f30e-4bbb-ab04-87f11f55e501 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 2a77980d-5760-4526-a9e7-dc3f71a4a0c0] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:39.748701 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7bef2d14-f30e-4bbb-ab04-87f11f55e501 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:39.749154 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7bef2d14-f30e-4bbb-ab04-87f11f55e501 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:39.749952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7bef2d14-f30e-4bbb-ab04-87f11f55e501 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:39.750395 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7bef2d14-f30e-4bbb-ab04-87f11f55e501 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:39.874627 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-7bef2d14-f30e-4bbb-ab04-87f11f55e501 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:39.881824 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-7bef2d14-f30e-4bbb-ab04-87f11f55e501 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0" status: 200 len: 1366 microversion: 2.1 time: 0.143962 May 12 11:53:39.882393 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 454/903] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:39 2022] GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:40.898957 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-c2fbea2a-753c-47b7-9bf7-8472695a50f7 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:40.899562 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-c2fbea2a-753c-47b7-9bf7-8472695a50f7 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 2a77980d-5760-4526-a9e7-dc3f71a4a0c0] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:40.906011 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c2fbea2a-753c-47b7-9bf7-8472695a50f7 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:40.906457 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c2fbea2a-753c-47b7-9bf7-8472695a50f7 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:40.907211 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c2fbea2a-753c-47b7-9bf7-8472695a50f7 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:40.907640 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c2fbea2a-753c-47b7-9bf7-8472695a50f7 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:41.037135 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-c2fbea2a-753c-47b7-9bf7-8472695a50f7 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:53:41.044838 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-c2fbea2a-753c-47b7-9bf7-8472695a50f7 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0" status: 200 len: 1556 microversion: 2.1 time: 0.149649 May 12 11:53:41.045390 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 450/904] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:53:40 2022] GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:53:41.061065 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-4b06249f-459e-43b8-8cd9-21029bc2feec tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:53:41.061580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-4b06249f-459e-43b8-8cd9-21029bc2feec tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 2a77980d-5760-4526-a9e7-dc3f71a4a0c0] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:53:41.067766 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4b06249f-459e-43b8-8cd9-21029bc2feec tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:41.068213 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4b06249f-459e-43b8-8cd9-21029bc2feec tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:41.068971 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4b06249f-459e-43b8-8cd9-21029bc2feec tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:41.069411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4b06249f-459e-43b8-8cd9-21029bc2feec tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:41.143379 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-4b06249f-459e-43b8-8cd9-21029bc2feec tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086626 May 12 11:53:41.143969 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 455/905] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 12 11:53:41 2022] GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:53:42.337184 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-f5fa2f42-fc53-440e-ba18-1ce220961498 req-b0e8af60-1626-4f7a-a6cf-d8e04a2487d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a77980d-5760-4526-a9e7-dc3f71a4a0c0", "tag": "b8ad170a-196a-4b05-b4b7-4d4cc26b5879"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:53:42.345668 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-f5fa2f42-fc53-440e-ba18-1ce220961498 req-b0e8af60-1626-4f7a-a6cf-d8e04a2487d8 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:53:42.346143 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-f5fa2f42-fc53-440e-ba18-1ce220961498 req-b0e8af60-1626-4f7a-a6cf-d8e04a2487d8 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:53:42.356711 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-f5fa2f42-fc53-440e-ba18-1ce220961498 req-b0e8af60-1626-4f7a-a6cf-d8e04a2487d8 service nova] Creating event network-changed:b8ad170a-196a-4b05-b4b7-4d4cc26b5879 for instance 2a77980d-5760-4526-a9e7-dc3f71a4a0c0 on hv-cinder-80473 May 12 11:53:42.361969 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-f5fa2f42-fc53-440e-ba18-1ce220961498 req-b0e8af60-1626-4f7a-a6cf-d8e04a2487d8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028669 May 12 11:53:42.362548 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 451/906] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:54:18.204545 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-966f4126-eedf-4f23-a1a6-e37d1aca10b9 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:18.205148 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-966f4126-eedf-4f23-a1a6-e37d1aca10b9 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 2a77980d-5760-4526-a9e7-dc3f71a4a0c0] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:18.210973 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-966f4126-eedf-4f23-a1a6-e37d1aca10b9 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:18.211416 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-966f4126-eedf-4f23-a1a6-e37d1aca10b9 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:18.212177 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-966f4126-eedf-4f23-a1a6-e37d1aca10b9 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:18.212606 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-966f4126-eedf-4f23-a1a6-e37d1aca10b9 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:18.238943 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-966f4126-eedf-4f23-a1a6-e37d1aca10b9 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0/ips" status: 200 len: 149 microversion: 2.1 time: 0.038931 May 12 11:54:18.239511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 456/907] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 12 11:54:18 2022] GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:54:18.251596 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-560171a9-92e3-4868-8ccf-48e306d51d5a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e90ee792-1084-4f20-a883-da02776d1575"}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:54:18.252761 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-560171a9-92e3-4868-8ccf-48e306d51d5a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 2a77980d-5760-4526-a9e7-dc3f71a4a0c0] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:18.258895 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-560171a9-92e3-4868-8ccf-48e306d51d5a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:18.259341 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-560171a9-92e3-4868-8ccf-48e306d51d5a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:18.260107 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-560171a9-92e3-4868-8ccf-48e306d51d5a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:18.260542 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-560171a9-92e3-4868-8ccf-48e306d51d5a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:18.335641 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-560171a9-92e3-4868-8ccf-48e306d51d5a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] HTTP exception thrown: Invalid volume: volume e90ee792-1084-4f20-a883-da02776d1575 is already attached to instances: 401ebf5c-6096-418a-b3bd-8e987ed84f6a May 12 11:54:18.337408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-560171a9-92e3-4868-8ccf-48e306d51d5a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Request method failure captured: May 12 11:54:18.337408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: POST /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0/os-volume_attachments HTTP/1.1 May 12 11:54:18.337408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:54:18.337408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:54:18.337408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:54:18.337408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 74 May 12 11:54:18.337408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:54:18.337408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:54:18.337408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:54:18.337408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:54:18.337408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPT8DEqCl4bX1_JU4Gitc3XogKR68P5YOrihZb3A5s6OOjrNceKy4j0AAlhI1OykUdJ79F3DICwWoBGKYb9sTlx-KD1LIJeTeUwhzJM4K7lZwKUqOtx8Qx0TugCbusjZJDLOtH8-zZzIn16n9DfmdO2XxMASJeCEJXf-EhUNFNzhC9Q May 12 11:54:18.337408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:54:18.337408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:54:18.337408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:54:18.337408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:54:18.337408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:54:18.337408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:54:18.337408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:54:18.337408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:54:18.337408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:54:18.337408 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:54:18.339392 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b284fcbfe0214240a616a6d68cedfed2", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:54:18.339392 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:54:18.339392 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:54:18.339392 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:54:18.339392 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:54:18.339392 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:54:18.339392 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:54:18.339392 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: 61fcd9d503734952b0ea9ec6ef96be6c May 12 11:54:18.339392 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:54:18.339392 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: May 12 11:54:18.339392 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {"volumeAttachment": {"volumeId": "e90ee792-1084-4f20-a883-da02776d1575"}} May 12 11:54:18.339392 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: > May 12 11:54:18.340516 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Invalid volume: volume e90ee792-1084-4f20-a883-da02776d1575 is already attached to instances: 401ebf5c-6096-418a-b3bd-8e987ed84f6a May 12 11:54:18.340516 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'server_id': '2a77980d-5760-4526-a9e7-dc3f71a4a0c0', 'body': {'volumeAttachment': {'volumeId': 'e90ee792-1084-4f20-a883-da02776d1575'}}} May 12 11:54:18.340516 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:54:18.340516 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:54:18.340516 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 11:54:18.340516 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 11:54:18.340516 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 11:54:18.340516 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 11:54:18.340516 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 11:54:18.340516 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 11:54:18.340516 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 12 11:54:18.340516 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 12 11:54:18.340516 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 12 11:54:18.340516 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 12 11:54:18.340516 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e90ee792-1084-4f20-a883-da02776d1575 is already attached to instances: 401ebf5c-6096-418a-b3bd-8e987ed84f6a May 12 11:54:18.340516 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:54:18.340516 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:54:18.340516 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:54:18.340516 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:54:18.342103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:54:18.342103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:54:18.342103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:54:18.342103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:54:18.342103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:54:18.342103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:54:18.342103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 11:54:18.342103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 11:54:18.342103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 11:54:18.342103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 11:54:18.342103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 11:54:18.342103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 11:54:18.342103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 12 11:54:18.342103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 11:54:18.342103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e90ee792-1084-4f20-a883-da02776d1575 is already attached to instances: 401ebf5c-6096-418a-b3bd-8e987ed84f6a May 12 11:54:18.342103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:54:18.342103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:54:18.342103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:54:18.342103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:54:18.342103 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:54:18.344433 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:54:18.344433 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:54:18.344433 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:54:18.344433 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e90ee792-1084-4f20-a883-da02776d1575 is already attached to instances: 401ebf5c-6096-418a-b3bd-8e987ed84f6a May 12 11:54:18.344433 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:54:18.344433 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-560171a9-92e3-4868-8ccf-48e306d51d5a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Returning 400 to user: Invalid volume: volume e90ee792-1084-4f20-a883-da02776d1575 is already attached to instances: 401ebf5c-6096-418a-b3bd-8e987ed84f6a {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:54:18.344433 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-560171a9-92e3-4868-8ccf-48e306d51d5a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "POST /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092079 May 12 11:54:18.344433 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 452/908] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 12 11:54:18 2022] POST /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 11:54:18.348187 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-75a1c7a8-bab1-4765-82dd-be20aac1b722 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:18.348687 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-75a1c7a8-bab1-4765-82dd-be20aac1b722 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 2a77980d-5760-4526-a9e7-dc3f71a4a0c0] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:18.354623 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-75a1c7a8-bab1-4765-82dd-be20aac1b722 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:18.355083 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-75a1c7a8-bab1-4765-82dd-be20aac1b722 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:18.355876 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-75a1c7a8-bab1-4765-82dd-be20aac1b722 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:18.356312 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-75a1c7a8-bab1-4765-82dd-be20aac1b722 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:18.380228 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-75a1c7a8-bab1-4765-82dd-be20aac1b722 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 2a77980d-5760-4526-a9e7-dc3f71a4a0c0] Going to try to terminate instance {{(pid=123508) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 11:54:18.452873 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-75a1c7a8-bab1-4765-82dd-be20aac1b722 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0" status: 204 len: 0 microversion: 2.1 time: 0.107495 May 12 11:54:18.453528 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 457/909] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:54:18 2022] DELETE /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 11:54:18.461565 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-6f084fd7-205c-4e4b-8e54-30c4052138d3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:18.462141 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-6f084fd7-205c-4e4b-8e54-30c4052138d3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 2a77980d-5760-4526-a9e7-dc3f71a4a0c0] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:18.469615 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6f084fd7-205c-4e4b-8e54-30c4052138d3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:18.470086 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6f084fd7-205c-4e4b-8e54-30c4052138d3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:18.470845 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6f084fd7-205c-4e4b-8e54-30c4052138d3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:18.471273 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6f084fd7-205c-4e4b-8e54-30c4052138d3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:18.603814 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-6f084fd7-205c-4e4b-8e54-30c4052138d3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:54:18.611052 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-6f084fd7-205c-4e4b-8e54-30c4052138d3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0" status: 200 len: 1680 microversion: 2.1 time: 0.153291 May 12 11:54:18.611610 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 453/910] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:54:18 2022] GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:54:19.629433 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-df3af1c1-b0bd-4a4d-9b88-da9b6c2d8779 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:19.630163 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-df3af1c1-b0bd-4a4d-9b88-da9b6c2d8779 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 2a77980d-5760-4526-a9e7-dc3f71a4a0c0] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:19.636456 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-df3af1c1-b0bd-4a4d-9b88-da9b6c2d8779 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:19.636909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-df3af1c1-b0bd-4a4d-9b88-da9b6c2d8779 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:19.637671 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-df3af1c1-b0bd-4a4d-9b88-da9b6c2d8779 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:19.638131 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-df3af1c1-b0bd-4a4d-9b88-da9b6c2d8779 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:19.771782 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-df3af1c1-b0bd-4a4d-9b88-da9b6c2d8779 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:54:19.779059 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-df3af1c1-b0bd-4a4d-9b88-da9b6c2d8779 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0" status: 200 len: 1680 microversion: 2.1 time: 0.154204 May 12 11:54:19.779634 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 458/911] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:54:19 2022] GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:54:20.797391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-bce7f0fe-a321-4970-8e31-87acdbca4877 req-1ed296d9-0384-43d9-812e-7f466bc05976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a77980d-5760-4526-a9e7-dc3f71a4a0c0", "name": "network-vif-deleted", "tag": "b8ad170a-196a-4b05-b4b7-4d4cc26b5879"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:54:20.802010 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-785aec5b-2cd5-4d7d-a350-d46fb4832ea4 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:20.802631 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-785aec5b-2cd5-4d7d-a350-d46fb4832ea4 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 2a77980d-5760-4526-a9e7-dc3f71a4a0c0] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:20.809213 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-785aec5b-2cd5-4d7d-a350-d46fb4832ea4 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:20.810172 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-785aec5b-2cd5-4d7d-a350-d46fb4832ea4 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:20.811190 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-785aec5b-2cd5-4d7d-a350-d46fb4832ea4 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:20.811816 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-785aec5b-2cd5-4d7d-a350-d46fb4832ea4 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:20.814071 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-bce7f0fe-a321-4970-8e31-87acdbca4877 req-1ed296d9-0384-43d9-812e-7f466bc05976 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:20.814520 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-bce7f0fe-a321-4970-8e31-87acdbca4877 req-1ed296d9-0384-43d9-812e-7f466bc05976 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:20.826592 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-bce7f0fe-a321-4970-8e31-87acdbca4877 req-1ed296d9-0384-43d9-812e-7f466bc05976 service nova] Creating event network-vif-deleted:b8ad170a-196a-4b05-b4b7-4d4cc26b5879 for instance 2a77980d-5760-4526-a9e7-dc3f71a4a0c0 on hv-cinder-80473 May 12 11:54:20.832830 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-bce7f0fe-a321-4970-8e31-87acdbca4877 req-1ed296d9-0384-43d9-812e-7f466bc05976 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039141 May 12 11:54:20.834067 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 459/912] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:54:20.893142 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-785aec5b-2cd5-4d7d-a350-d46fb4832ea4 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:54:20.901327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-785aec5b-2cd5-4d7d-a350-d46fb4832ea4 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0" status: 200 len: 1612 microversion: 2.1 time: 0.108836 May 12 11:54:20.902533 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 454/913] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:54:20 2022] GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0 => generated 1612 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:54:21.919290 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-4b921ee7-ff6f-4ba5-b9cc-e015d1742f65 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:21.919996 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-4b921ee7-ff6f-4ba5-b9cc-e015d1742f65 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 2a77980d-5760-4526-a9e7-dc3f71a4a0c0] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:21.926737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4b921ee7-ff6f-4ba5-b9cc-e015d1742f65 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:21.927199 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4b921ee7-ff6f-4ba5-b9cc-e015d1742f65 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:21.927986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4b921ee7-ff6f-4ba5-b9cc-e015d1742f65 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:21.928427 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4b921ee7-ff6f-4ba5-b9cc-e015d1742f65 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:21.942962 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-4b921ee7-ff6f-4ba5-b9cc-e015d1742f65 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] HTTP exception thrown: Instance 2a77980d-5760-4526-a9e7-dc3f71a4a0c0 could not be found. May 12 11:54:21.944670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-4b921ee7-ff6f-4ba5-b9cc-e015d1742f65 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Request method failure captured: May 12 11:54:21.944670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0 HTTP/1.1 May 12 11:54:21.944670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:54:21.944670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:54:21.944670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:54:21.944670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:54:21.944670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:54:21.944670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:54:21.944670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:54:21.944670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:54:21.944670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPT8DEqCl4bX1_JU4Gitc3XogKR68P5YOrihZb3A5s6OOjrNceKy4j0AAlhI1OykUdJ79F3DICwWoBGKYb9sTlx-KD1LIJeTeUwhzJM4K7lZwKUqOtx8Qx0TugCbusjZJDLOtH8-zZzIn16n9DfmdO2XxMASJeCEJXf-EhUNFNzhC9Q May 12 11:54:21.944670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:54:21.944670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:54:21.944670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:54:21.944670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:54:21.944670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:54:21.944670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:54:21.944670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:54:21.944670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:54:21.944670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:54:21.944670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:54:21.946540 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b284fcbfe0214240a616a6d68cedfed2", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:54:21.946540 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:54:21.946540 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:54:21.946540 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:54:21.946540 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:54:21.946540 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:54:21.946540 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:54:21.946540 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 61fcd9d503734952b0ea9ec6ef96be6c May 12 11:54:21.946540 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:54:21.946540 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:54:21.946540 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance 2a77980d-5760-4526-a9e7-dc3f71a4a0c0 could not be found. May 12 11:54:21.946540 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': '2a77980d-5760-4526-a9e7-dc3f71a4a0c0'} May 12 11:54:21.947342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:54:21.947342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:54:21.947342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:54:21.947342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:54:21.947342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:54:21.947342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:54:21.947342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:54:21.947342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:54:21.947342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:54:21.947342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:54:21.947342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a77980d-5760-4526-a9e7-dc3f71a4a0c0 could not be found. May 12 11:54:21.947342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:54:21.947342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:54:21.947342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:54:21.947342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:54:21.947342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:54:21.947342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:54:21.947342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:54:21.947342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:54:21.947342 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:54:21.948712 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:54:21.948712 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:54:21.948712 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:54:21.948712 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:54:21.948712 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:54:21.948712 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:54:21.948712 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:54:21.948712 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a77980d-5760-4526-a9e7-dc3f71a4a0c0 could not be found. May 12 11:54:21.948712 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:54:21.948712 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:54:21.948712 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:54:21.948712 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:54:21.948712 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:54:21.948712 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:54:21.948712 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:54:21.948712 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:54:21.948712 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a77980d-5760-4526-a9e7-dc3f71a4a0c0 could not be found. May 12 11:54:21.948712 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:54:21.950218 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-4b921ee7-ff6f-4ba5-b9cc-e015d1742f65 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Returning 404 to user: Instance 2a77980d-5760-4526-a9e7-dc3f71a4a0c0 could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:54:21.950218 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-4b921ee7-ff6f-4ba5-b9cc-e015d1742f65 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0" status: 404 len: 111 microversion: 2.1 time: 0.031687 May 12 11:54:21.950218 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 460/914] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:54:21 2022] GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:54:21.956456 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-8957e9a6-7540-414a-bc32-9feb4bcf9188 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '.version_select at 0x7f29f1c913a0>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:21.974986 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-8957e9a6-7540-414a-bc32-9feb4bcf9188 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-978292019" status: 202 len: 0 microversion: 2.1 time: 0.023657 May 12 11:54:21.975554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 455/915] 10.222.0.58 () {58 vars in 1217 bytes} [Thu May 12 11:54:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-978292019 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 11:54:22.607255 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-0f1089fa-0daa-4e5c-a753-6859347bb80d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:22.607754 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-0f1089fa-0daa-4e5c-a753-6859347bb80d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:22.613753 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0f1089fa-0daa-4e5c-a753-6859347bb80d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:22.614215 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0f1089fa-0daa-4e5c-a753-6859347bb80d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:22.614990 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0f1089fa-0daa-4e5c-a753-6859347bb80d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:22.615433 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0f1089fa-0daa-4e5c-a753-6859347bb80d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:22.691952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.objects.instance [None req-0f1089fa-0daa-4e5c-a753-6859347bb80d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lazy-loading 'services' on Instance uuid 401ebf5c-6096-418a-b3bd-8e987ed84f6a {{(pid=123508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:54:22.760472 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-0f1089fa-0daa-4e5c-a753-6859347bb80d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "DELETE /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a/os-volume_attachments/e90ee792-1084-4f20-a883-da02776d1575" status: 202 len: 0 microversion: 2.1 time: 0.156938 May 12 11:54:22.761407 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 461/916] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 12 11:54:22 2022] DELETE /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a/os-volume_attachments/e90ee792-1084-4f20-a883-da02776d1575 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:54:22.769866 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-84927747-9eb3-4261-9ed5-a09f0ef770f6 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:22.770790 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-84927747-9eb3-4261-9ed5-a09f0ef770f6 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:22.777519 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-84927747-9eb3-4261-9ed5-a09f0ef770f6 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:22.778017 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-84927747-9eb3-4261-9ed5-a09f0ef770f6 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:22.778802 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-84927747-9eb3-4261-9ed5-a09f0ef770f6 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:22.779237 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-84927747-9eb3-4261-9ed5-a09f0ef770f6 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:22.807938 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-84927747-9eb3-4261-9ed5-a09f0ef770f6 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042025 May 12 11:54:22.808504 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 456/917] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 12 11:54:22 2022] GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:54:23.820372 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-1ad77658-a37b-4c6d-862c-81bd0b1ab614 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:23.821389 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-1ad77658-a37b-4c6d-862c-81bd0b1ab614 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:23.828433 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1ad77658-a37b-4c6d-862c-81bd0b1ab614 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:23.828887 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1ad77658-a37b-4c6d-862c-81bd0b1ab614 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:23.829660 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1ad77658-a37b-4c6d-862c-81bd0b1ab614 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:23.830128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1ad77658-a37b-4c6d-862c-81bd0b1ab614 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:23.858343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-1ad77658-a37b-4c6d-862c-81bd0b1ab614 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042320 May 12 11:54:23.858898 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 462/918] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 12 11:54:23 2022] GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 11:54:23.913643 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-888a4674-a2cb-43d2-a766-6804c2a6310b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:23.914180 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-888a4674-a2cb-43d2-a766-6804c2a6310b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:23.920572 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-888a4674-a2cb-43d2-a766-6804c2a6310b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:23.921017 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-888a4674-a2cb-43d2-a766-6804c2a6310b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:23.921820 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-888a4674-a2cb-43d2-a766-6804c2a6310b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:23.922259 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-888a4674-a2cb-43d2-a766-6804c2a6310b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:23.948465 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-888a4674-a2cb-43d2-a766-6804c2a6310b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Going to try to terminate instance {{(pid=123507) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 11:54:24.175153 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-888a4674-a2cb-43d2-a766-6804c2a6310b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "DELETE /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a" status: 204 len: 0 microversion: 2.1 time: 0.265065 May 12 11:54:24.175819 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 457/919] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:54:23 2022] DELETE /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 11:54:24.184404 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-33400dfb-680a-422a-8299-a4e56eb5609e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:24.185043 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-33400dfb-680a-422a-8299-a4e56eb5609e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:24.191786 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-33400dfb-680a-422a-8299-a4e56eb5609e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:24.192235 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-33400dfb-680a-422a-8299-a4e56eb5609e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:24.193010 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-33400dfb-680a-422a-8299-a4e56eb5609e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:24.193626 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-33400dfb-680a-422a-8299-a4e56eb5609e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:24.320991 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-33400dfb-680a-422a-8299-a4e56eb5609e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:54:24.328763 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-33400dfb-680a-422a-8299-a4e56eb5609e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a" status: 200 len: 1680 microversion: 2.1 time: 0.148726 May 12 11:54:24.329321 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 463/920] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:54:24 2022] GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:54:25.346498 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-d0465fa4-a67c-433c-940e-0f6f35deb15c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:25.347197 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d0465fa4-a67c-433c-940e-0f6f35deb15c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:25.354047 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d0465fa4-a67c-433c-940e-0f6f35deb15c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:25.354499 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d0465fa4-a67c-433c-940e-0f6f35deb15c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:25.355262 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d0465fa4-a67c-433c-940e-0f6f35deb15c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:25.355699 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d0465fa4-a67c-433c-940e-0f6f35deb15c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:25.479627 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-d0465fa4-a67c-433c-940e-0f6f35deb15c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:54:25.487448 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-d0465fa4-a67c-433c-940e-0f6f35deb15c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a" status: 200 len: 1680 microversion: 2.1 time: 0.145723 May 12 11:54:25.487993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 458/921] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:54:25 2022] GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:54:26.504945 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-cf8f57eb-c515-4bb0-ab4f-16a1f8bad782 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:26.505567 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-cf8f57eb-c515-4bb0-ab4f-16a1f8bad782 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:26.512033 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cf8f57eb-c515-4bb0-ab4f-16a1f8bad782 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:26.512435 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cf8f57eb-c515-4bb0-ab4f-16a1f8bad782 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:26.513207 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cf8f57eb-c515-4bb0-ab4f-16a1f8bad782 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:26.513644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-cf8f57eb-c515-4bb0-ab4f-16a1f8bad782 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:26.578870 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-cf8f57eb-c515-4bb0-ab4f-16a1f8bad782 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:54:26.586223 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-cf8f57eb-c515-4bb0-ab4f-16a1f8bad782 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a" status: 200 len: 1613 microversion: 2.1 time: 0.085285 May 12 11:54:26.586800 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 464/922] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:54:26 2022] GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a => generated 1613 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:54:26.695043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-ea42a347-4c10-4485-8e9a-49aea41f75d4 req-1bbcb21a-9a1d-48f3-b383-0840cc446670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401ebf5c-6096-418a-b3bd-8e987ed84f6a", "name": "network-vif-deleted", "tag": "214a8d47-81ba-42fa-93f3-810b85245b45"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:54:26.705851 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-ea42a347-4c10-4485-8e9a-49aea41f75d4 req-1bbcb21a-9a1d-48f3-b383-0840cc446670 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:26.706295 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-ea42a347-4c10-4485-8e9a-49aea41f75d4 req-1bbcb21a-9a1d-48f3-b383-0840cc446670 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:26.718730 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-ea42a347-4c10-4485-8e9a-49aea41f75d4 req-1bbcb21a-9a1d-48f3-b383-0840cc446670 service nova] Creating event network-vif-deleted:214a8d47-81ba-42fa-93f3-810b85245b45 for instance 401ebf5c-6096-418a-b3bd-8e987ed84f6a on hv-cinder-80473 May 12 11:54:26.724910 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-ea42a347-4c10-4485-8e9a-49aea41f75d4 req-1bbcb21a-9a1d-48f3-b383-0840cc446670 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033038 May 12 11:54:26.725605 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 459/923] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:54:27.603985 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-04659488-1375-4f37-9046-500adae63a6a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:27.604526 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-04659488-1375-4f37-9046-500adae63a6a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:27.611047 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-04659488-1375-4f37-9046-500adae63a6a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:27.611503 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-04659488-1375-4f37-9046-500adae63a6a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:27.612287 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-04659488-1375-4f37-9046-500adae63a6a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:27.612733 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-04659488-1375-4f37-9046-500adae63a6a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:27.626528 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-04659488-1375-4f37-9046-500adae63a6a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] HTTP exception thrown: Instance 401ebf5c-6096-418a-b3bd-8e987ed84f6a could not be found. May 12 11:54:27.628180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-04659488-1375-4f37-9046-500adae63a6a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Request method failure captured: May 12 11:54:27.628180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a HTTP/1.1 May 12 11:54:27.628180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:54:27.628180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:54:27.628180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:54:27.628180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:54:27.628180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:54:27.628180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:54:27.628180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:54:27.628180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:54:27.628180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPT8DEqCl4bX1_JU4Gitc3XogKR68P5YOrihZb3A5s6OOjrNceKy4j0AAlhI1OykUdJ79F3DICwWoBGKYb9sTlx-KD1LIJeTeUwhzJM4K7lZwKUqOtx8Qx0TugCbusjZJDLOtH8-zZzIn16n9DfmdO2XxMASJeCEJXf-EhUNFNzhC9Q May 12 11:54:27.628180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:54:27.628180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:54:27.628180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:54:27.628180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:54:27.628180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:54:27.628180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:54:27.628180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:54:27.628180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:54:27.628180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:54:27.628180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:54:27.629786 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b284fcbfe0214240a616a6d68cedfed2", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:54:27.629786 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:54:27.629786 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:54:27.629786 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:54:27.629786 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:54:27.629786 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:54:27.629786 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:54:27.629786 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 61fcd9d503734952b0ea9ec6ef96be6c May 12 11:54:27.629786 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:54:27.629786 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:54:27.629786 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance 401ebf5c-6096-418a-b3bd-8e987ed84f6a could not be found. May 12 11:54:27.629786 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': '401ebf5c-6096-418a-b3bd-8e987ed84f6a'} May 12 11:54:27.630553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:54:27.630553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:54:27.630553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:54:27.630553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:54:27.630553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:54:27.630553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:54:27.630553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:54:27.630553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:54:27.630553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:54:27.630553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:54:27.630553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 401ebf5c-6096-418a-b3bd-8e987ed84f6a could not be found. May 12 11:54:27.630553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:54:27.630553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:54:27.630553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:54:27.630553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:54:27.630553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:54:27.630553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:54:27.630553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:54:27.630553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:54:27.630553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:54:27.631746 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:54:27.631746 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:54:27.631746 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:54:27.631746 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:54:27.631746 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:54:27.631746 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:54:27.631746 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:54:27.631746 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 401ebf5c-6096-418a-b3bd-8e987ed84f6a could not be found. May 12 11:54:27.631746 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:54:27.631746 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:54:27.631746 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:54:27.631746 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:54:27.631746 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:54:27.631746 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:54:27.631746 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:54:27.631746 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:54:27.631746 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 401ebf5c-6096-418a-b3bd-8e987ed84f6a could not be found. May 12 11:54:27.631746 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:54:27.632891 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-04659488-1375-4f37-9046-500adae63a6a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Returning 404 to user: Instance 401ebf5c-6096-418a-b3bd-8e987ed84f6a could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:54:27.632891 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-04659488-1375-4f37-9046-500adae63a6a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a" status: 404 len: 111 microversion: 2.1 time: 0.029543 May 12 11:54:27.632891 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 465/924] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:54:27 2022] GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:54:27.641485 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-d12221fc-405a-4ea9-a9ff-bad668e4de56 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '.version_select at 0x7f29f77830d0>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:27.659285 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-d12221fc-405a-4ea9-a9ff-bad668e4de56 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-139823241" status: 202 len: 0 microversion: 2.1 time: 0.023961 May 12 11:54:27.660104 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 460/925] 10.222.0.58 () {58 vars in 1217 bytes} [Thu May 12 11:54:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-139823241 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:54:28.263557 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-094ed0ec-374e-4843-b2c7-6913446c99e3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Action: 'create', calling method: .version_select at 0x7f29f252edc0>, body: {"keypair": {"name": "tempest-keypair-5133871", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEc6Gr5+bF5v+Hs4hUXM/wQ+E7tKYFJ5JZqTzH/itITkAjuvxHIYZFHwY6erxwwWydKqiSJSiQsvtvrHz2HxLdh/1zE4zBtRTZh+wBynWdByxQ+1WFhvcPAxBy7QHhGdqg=="}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:54:28.285177 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-094ed0ec-374e-4843-b2c7-6913446c99e3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Getting quotas for project b284fcbfe0214240a616a6d68cedfed2. Resources: {'key_pairs'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:54:28.288908 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-094ed0ec-374e-4843-b2c7-6913446c99e3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Getting quotas for user 61fcd9d503734952b0ea9ec6ef96be6c and project b284fcbfe0214240a616a6d68cedfed2. Resources: {'key_pairs'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:54:28.310063 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-094ed0ec-374e-4843-b2c7-6913446c99e3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.050408 May 12 11:54:28.310670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 466/926] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 12 11:54:28 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:54:29.518008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-88b6edc1-74b2-4c58-b5ee-e1279e227258 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1806336612", "imageRef": "576e8b7b-771b-47aa-89c6-ff04accc9bea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b35a8e2-7cac-4312-8515-92a011fa862b"}], "security_groups": [{"name": "tempest-securitygroup--267182477"}], "key_name": "tempest-keypair-5133871", "user_data": "}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:54:29.618043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.network.neutron [None req-88b6edc1-74b2-4c58-b5ee-e1279e227258 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] validate_networks() for [('7b35a8e2-7cac-4312-8515-92a011fa862b', None, None, None, None, None)] {{(pid=123507) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 11:54:29.973232 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-88b6edc1-74b2-4c58-b5ee-e1279e227258 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Flavor limits 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 11:54:29.973605 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-88b6edc1-74b2-4c58-b5ee-e1279e227258 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Image limits 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 11:54:29.974121 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-88b6edc1-74b2-4c58-b5ee-e1279e227258 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Flavor pref 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 11:54:29.974528 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-88b6edc1-74b2-4c58-b5ee-e1279e227258 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Image pref 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 11:54:29.974936 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-88b6edc1-74b2-4c58-b5ee-e1279e227258 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 11:54:29.983477 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-88b6edc1-74b2-4c58-b5ee-e1279e227258 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:29.983923 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-88b6edc1-74b2-4c58-b5ee-e1279e227258 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:29.984720 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-88b6edc1-74b2-4c58-b5ee-e1279e227258 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:29.985155 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-88b6edc1-74b2-4c58-b5ee-e1279e227258 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:30.001418 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-88b6edc1-74b2-4c58-b5ee-e1279e227258 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Getting quotas for project b284fcbfe0214240a616a6d68cedfed2. Resources: {'ram', 'cores', 'instances'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:54:30.005265 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-88b6edc1-74b2-4c58-b5ee-e1279e227258 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Getting quotas for user 61fcd9d503734952b0ea9ec6ef96be6c and project b284fcbfe0214240a616a6d68cedfed2. Resources: {'ram', 'cores', 'instances'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:54:30.016472 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-88b6edc1-74b2-4c58-b5ee-e1279e227258 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Going to run 1 instances... {{(pid=123507) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 11:54:30.018814 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-88b6edc1-74b2-4c58-b5ee-e1279e227258 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='576e8b7b-771b-47aa-89c6-ff04accc9bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123507) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 11:54:30.064331 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-88b6edc1-74b2-4c58-b5ee-e1279e227258 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.551077 May 12 11:54:30.064968 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 461/927] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 12 11:54:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 11:54:30.075248 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-567a5574-e7d0-4942-89e1-f5d1c306b93d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:30.075945 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-567a5574-e7d0-4942-89e1-f5d1c306b93d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:30.130499 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-567a5574-e7d0-4942-89e1-f5d1c306b93d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:54:30.137029 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-567a5574-e7d0-4942-89e1-f5d1c306b93d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d" status: 200 len: 1239 microversion: 2.1 time: 0.066039 May 12 11:54:30.137627 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 467/928] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:54:30 2022] GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:54:31.154279 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-551f4c20-3197-499d-918e-3396762e3857 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:31.154833 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-551f4c20-3197-499d-918e-3396762e3857 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:31.160983 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-551f4c20-3197-499d-918e-3396762e3857 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:31.161431 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-551f4c20-3197-499d-918e-3396762e3857 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:31.162233 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-551f4c20-3197-499d-918e-3396762e3857 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:31.162701 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-551f4c20-3197-499d-918e-3396762e3857 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:31.222868 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-551f4c20-3197-499d-918e-3396762e3857 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:54:31.230068 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-551f4c20-3197-499d-918e-3396762e3857 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d" status: 200 len: 1297 microversion: 2.1 time: 0.080148 May 12 11:54:31.230627 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 462/929] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:54:31 2022] GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d => generated 1297 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:54:32.247553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-24493b4b-2cce-4643-8308-984cb4c12fc2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:32.248151 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-24493b4b-2cce-4643-8308-984cb4c12fc2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:32.255332 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-24493b4b-2cce-4643-8308-984cb4c12fc2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:32.255775 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-24493b4b-2cce-4643-8308-984cb4c12fc2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:32.256553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-24493b4b-2cce-4643-8308-984cb4c12fc2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:32.256988 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-24493b4b-2cce-4643-8308-984cb4c12fc2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:32.385858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-24493b4b-2cce-4643-8308-984cb4c12fc2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:54:32.393779 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-24493b4b-2cce-4643-8308-984cb4c12fc2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d" status: 200 len: 1364 microversion: 2.1 time: 0.150101 May 12 11:54:32.394348 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 468/930] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:54:32 2022] GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:54:32.697087 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-43b3e0c8-3d08-46ca-b102-cfd85f72339e req-0821d52f-35e9-42e9-9444-776ce85beb6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d", "tag": "9e40bffb-6790-40e2-907b-99ec56c50c04"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:54:32.707177 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-43b3e0c8-3d08-46ca-b102-cfd85f72339e req-0821d52f-35e9-42e9-9444-776ce85beb6b service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:32.708687 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-43b3e0c8-3d08-46ca-b102-cfd85f72339e req-0821d52f-35e9-42e9-9444-776ce85beb6b service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:32.729488 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-43b3e0c8-3d08-46ca-b102-cfd85f72339e req-0821d52f-35e9-42e9-9444-776ce85beb6b service nova] Creating event network-changed:9e40bffb-6790-40e2-907b-99ec56c50c04 for instance 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d on hv-cinder-80473 May 12 11:54:32.736027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-43b3e0c8-3d08-46ca-b102-cfd85f72339e req-0821d52f-35e9-42e9-9444-776ce85beb6b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047006 May 12 11:54:32.736635 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 463/931] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:54:33.410989 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-e8e37d56-b139-42f0-aba4-de9c7f7b2c6c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:33.411553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-e8e37d56-b139-42f0-aba4-de9c7f7b2c6c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:33.417788 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e8e37d56-b139-42f0-aba4-de9c7f7b2c6c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:33.418247 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e8e37d56-b139-42f0-aba4-de9c7f7b2c6c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:33.419027 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e8e37d56-b139-42f0-aba4-de9c7f7b2c6c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:33.419447 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e8e37d56-b139-42f0-aba4-de9c7f7b2c6c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:33.547717 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-e8e37d56-b139-42f0-aba4-de9c7f7b2c6c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:54:33.555198 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-e8e37d56-b139-42f0-aba4-de9c7f7b2c6c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d" status: 200 len: 1364 microversion: 2.1 time: 0.148232 May 12 11:54:33.555797 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 469/932] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:54:33 2022] GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:54:34.572468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-9911643a-d4cc-4962-bf5f-5de70c966ad3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:34.573307 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-9911643a-d4cc-4962-bf5f-5de70c966ad3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:34.579921 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9911643a-d4cc-4962-bf5f-5de70c966ad3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:34.580453 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9911643a-d4cc-4962-bf5f-5de70c966ad3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:34.581245 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9911643a-d4cc-4962-bf5f-5de70c966ad3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:34.581690 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9911643a-d4cc-4962-bf5f-5de70c966ad3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:34.801520 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-9911643a-d4cc-4962-bf5f-5de70c966ad3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:54:34.808729 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-9911643a-d4cc-4962-bf5f-5de70c966ad3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d" status: 200 len: 1364 microversion: 2.1 time: 0.240502 May 12 11:54:34.809329 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 464/933] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:54:34 2022] GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:54:35.117978 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-4c055790-bbd8-4b5c-a711-c7a93236abbb tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:35.118488 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-4c055790-bbd8-4b5c-a711-c7a93236abbb tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:35.119479 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-76610d70-46ae-4956-91dc-ddc7c9508d6b req-0ebe8585-1e72-4faa-9e39-a12966f659f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d747a75-e74d-4c41-9707-aee578ce2d01", "tag": "0b817862-786a-4db4-bdba-c4efd02f2cda"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:54:35.125517 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4c055790-bbd8-4b5c-a711-c7a93236abbb tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:35.126263 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4c055790-bbd8-4b5c-a711-c7a93236abbb tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:35.127256 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4c055790-bbd8-4b5c-a711-c7a93236abbb tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:35.127906 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4c055790-bbd8-4b5c-a711-c7a93236abbb tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:35.128945 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-76610d70-46ae-4956-91dc-ddc7c9508d6b req-0ebe8585-1e72-4faa-9e39-a12966f659f5 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:35.129459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-76610d70-46ae-4956-91dc-ddc7c9508d6b req-0ebe8585-1e72-4faa-9e39-a12966f659f5 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:35.143156 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-76610d70-46ae-4956-91dc-ddc7c9508d6b req-0ebe8585-1e72-4faa-9e39-a12966f659f5 service nova] Creating event network-changed:0b817862-786a-4db4-bdba-c4efd02f2cda for instance 8d747a75-e74d-4c41-9707-aee578ce2d01 on hv-cinder-80473 May 12 11:54:35.150025 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-76610d70-46ae-4956-91dc-ddc7c9508d6b req-0ebe8585-1e72-4faa-9e39-a12966f659f5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034099 May 12 11:54:35.150622 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 465/934] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:54:35.154059 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-4c055790-bbd8-4b5c-a711-c7a93236abbb tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Going to try to terminate instance {{(pid=123508) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 11:54:35.234519 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-4c055790-bbd8-4b5c-a711-c7a93236abbb tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 204 len: 0 microversion: 2.1 time: 0.120319 May 12 11:54:35.235310 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 470/935] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:54:35 2022] DELETE /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 11:54:35.246187 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-70abd888-ab7e-4b35-b36a-bb55bc662e1e tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:35.246964 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-70abd888-ab7e-4b35-b36a-bb55bc662e1e tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:35.253735 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-70abd888-ab7e-4b35-b36a-bb55bc662e1e tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:35.254327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-70abd888-ab7e-4b35-b36a-bb55bc662e1e tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:35.255111 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-70abd888-ab7e-4b35-b36a-bb55bc662e1e tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:35.255549 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-70abd888-ab7e-4b35-b36a-bb55bc662e1e tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:35.385965 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-70abd888-ab7e-4b35-b36a-bb55bc662e1e tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:54:35.393907 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-70abd888-ab7e-4b35-b36a-bb55bc662e1e tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1568 microversion: 2.1 time: 0.152487 May 12 11:54:35.394468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 466/936] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:54:35 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:54:35.825769 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-80a5ada0-2eeb-469b-a95b-69234cd94f3b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:35.826477 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-80a5ada0-2eeb-469b-a95b-69234cd94f3b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:35.832265 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-80a5ada0-2eeb-469b-a95b-69234cd94f3b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:35.832712 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-80a5ada0-2eeb-469b-a95b-69234cd94f3b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:35.833477 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-80a5ada0-2eeb-469b-a95b-69234cd94f3b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:35.833936 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-80a5ada0-2eeb-469b-a95b-69234cd94f3b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:35.964072 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-80a5ada0-2eeb-469b-a95b-69234cd94f3b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:54:35.973173 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-80a5ada0-2eeb-469b-a95b-69234cd94f3b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d" status: 200 len: 1364 microversion: 2.1 time: 0.151455 May 12 11:54:35.973638 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 471/937] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:54:35 2022] GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:54:36.412922 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-c76ac6b9-a84e-423e-ae8f-1b4b7832521e tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:36.413569 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-c76ac6b9-a84e-423e-ae8f-1b4b7832521e tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:36.419520 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c76ac6b9-a84e-423e-ae8f-1b4b7832521e tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:36.419969 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c76ac6b9-a84e-423e-ae8f-1b4b7832521e tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:36.420762 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c76ac6b9-a84e-423e-ae8f-1b4b7832521e tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:36.421202 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-c76ac6b9-a84e-423e-ae8f-1b4b7832521e tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:36.580428 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-c76ac6b9-a84e-423e-ae8f-1b4b7832521e tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:54:36.587971 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-c76ac6b9-a84e-423e-ae8f-1b4b7832521e tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1568 microversion: 2.1 time: 0.180029 May 12 11:54:36.588569 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 467/938] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:54:36 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:54:36.991644 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b6a1e107-7a1f-4948-96af-b4363b292805 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:36.992430 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-b6a1e107-7a1f-4948-96af-b4363b292805 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:37.001334 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b6a1e107-7a1f-4948-96af-b4363b292805 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:37.001952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b6a1e107-7a1f-4948-96af-b4363b292805 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:37.002835 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b6a1e107-7a1f-4948-96af-b4363b292805 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:37.003353 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b6a1e107-7a1f-4948-96af-b4363b292805 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:37.220559 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b6a1e107-7a1f-4948-96af-b4363b292805 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:54:37.228376 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-b6a1e107-7a1f-4948-96af-b4363b292805 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d" status: 200 len: 1364 microversion: 2.1 time: 0.241816 May 12 11:54:37.228956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 472/939] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:54:36 2022] GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d => generated 1364 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:54:37.445644 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-1400be66-de9b-4084-9bdd-2e03e18ce43a req-32dddac9-820f-482d-8b96-79646e65bc8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d747a75-e74d-4c41-9707-aee578ce2d01", "name": "network-vif-deleted", "tag": "0b817862-786a-4db4-bdba-c4efd02f2cda"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:54:37.460823 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-1400be66-de9b-4084-9bdd-2e03e18ce43a req-32dddac9-820f-482d-8b96-79646e65bc8d service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:37.461388 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-1400be66-de9b-4084-9bdd-2e03e18ce43a req-32dddac9-820f-482d-8b96-79646e65bc8d service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:37.473060 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-1400be66-de9b-4084-9bdd-2e03e18ce43a req-32dddac9-820f-482d-8b96-79646e65bc8d service nova] Creating event network-vif-deleted:0b817862-786a-4db4-bdba-c4efd02f2cda for instance 8d747a75-e74d-4c41-9707-aee578ce2d01 on hv-cinder-80473 May 12 11:54:37.477894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-1400be66-de9b-4084-9bdd-2e03e18ce43a req-32dddac9-820f-482d-8b96-79646e65bc8d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035817 May 12 11:54:37.479088 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 468/940] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:54:37.605211 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-2b02f017-b589-4d38-9a76-ccf5ff4462a6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:37.605781 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-2b02f017-b589-4d38-9a76-ccf5ff4462a6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:37.611643 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2b02f017-b589-4d38-9a76-ccf5ff4462a6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:37.612092 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2b02f017-b589-4d38-9a76-ccf5ff4462a6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:37.612861 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2b02f017-b589-4d38-9a76-ccf5ff4462a6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:37.613302 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2b02f017-b589-4d38-9a76-ccf5ff4462a6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:37.682683 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-2b02f017-b589-4d38-9a76-ccf5ff4462a6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f6da611aff04192a59cd39f3b2d6cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde372d003ca4f5fbafa9d6a4bc52e3e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:54:37.691470 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-2b02f017-b589-4d38-9a76-ccf5ff4462a6 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 200 len: 1218 microversion: 2.1 time: 0.090122 May 12 11:54:37.692054 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 473/941] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:54:37 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:54:38.245424 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-a397855c-d4bb-4333-97bd-a464a5b48e1d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:38.246146 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-a397855c-d4bb-4333-97bd-a464a5b48e1d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:38.252767 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a397855c-d4bb-4333-97bd-a464a5b48e1d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:38.253266 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a397855c-d4bb-4333-97bd-a464a5b48e1d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:38.254063 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a397855c-d4bb-4333-97bd-a464a5b48e1d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:38.254498 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a397855c-d4bb-4333-97bd-a464a5b48e1d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:38.382513 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-a397855c-d4bb-4333-97bd-a464a5b48e1d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:54:38.389607 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-a397855c-d4bb-4333-97bd-a464a5b48e1d tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d" status: 200 len: 1364 microversion: 2.1 time: 0.148406 May 12 11:54:38.390190 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 469/942] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:54:38 2022] GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:54:38.708776 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-adff15f3-5a7f-403e-8eb4-7c00b26857d8 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:38.709405 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-adff15f3-5a7f-403e-8eb4-7c00b26857d8 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] [instance: 8d747a75-e74d-4c41-9707-aee578ce2d01] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:38.715932 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-adff15f3-5a7f-403e-8eb4-7c00b26857d8 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:38.716404 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-adff15f3-5a7f-403e-8eb4-7c00b26857d8 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:38.717162 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-adff15f3-5a7f-403e-8eb4-7c00b26857d8 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:38.717597 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-adff15f3-5a7f-403e-8eb4-7c00b26857d8 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:38.731300 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-adff15f3-5a7f-403e-8eb4-7c00b26857d8 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] HTTP exception thrown: Instance 8d747a75-e74d-4c41-9707-aee578ce2d01 could not be found. May 12 11:54:38.733128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-adff15f3-5a7f-403e-8eb4-7c00b26857d8 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Request method failure captured: May 12 11:54:38.733128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 HTTP/1.1 May 12 11:54:38.733128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:54:38.733128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:54:38.733128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:54:38.733128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:54:38.733128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:54:38.733128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:54:38.733128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:54:38.733128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:54:38.733128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPRhhLfe7KFtlvagOySyCaHNr6ZUueqnhljhtNZxLytQErlOlrwsWhv_HSM8xjM_ozHDCwc--VkUUJ1hgu0B4yo2f5znlMoc7dQrYDG0rwNYRV3rssxDOiJ6GGHhTxOqXJWpIQQsTyiGmHk8ac-sCy6SF9WpBg_8-lz7M4pBjAm2s0Y May 12 11:54:38.733128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:54:38.733128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:54:38.733128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:54:38.733128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:54:38.733128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:54:38.733128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:54:38.733128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: cde372d003ca4f5fbafa9d6a4bc52e3e May 12 11:54:38.733128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-TestShelveInstance-1499725121 May 12 11:54:38.733128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:54:38.733128 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:54:38.735198 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cde372d003ca4f5fbafa9d6a4bc52e3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cde372d003ca4f5fbafa9d6a4bc52e3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cde372d003ca4f5fbafa9d6a4bc52e3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cde372d003ca4f5fbafa9d6a4bc52e3e", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:54:38.735198 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-TestShelveInstance-1499725121 May 12 11:54:38.735198 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: cde372d003ca4f5fbafa9d6a4bc52e3e May 12 11:54:38.735198 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-TestShelveInstance-1499725121 May 12 11:54:38.735198 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-TestShelveInstance-1499725121-project May 12 11:54:38.735198 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:54:38.735198 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:54:38.735198 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 7f6da611aff04192a59cd39f3b2d6cb6 May 12 11:54:38.735198 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-TestShelveInstance-1499725121-project May 12 11:54:38.735198 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:54:38.735198 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance 8d747a75-e74d-4c41-9707-aee578ce2d01 could not be found. May 12 11:54:38.735198 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': '8d747a75-e74d-4c41-9707-aee578ce2d01'} May 12 11:54:38.736147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:54:38.736147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:54:38.736147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:54:38.736147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:54:38.736147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:54:38.736147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:54:38.736147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:54:38.736147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:54:38.736147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:54:38.736147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:54:38.736147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d747a75-e74d-4c41-9707-aee578ce2d01 could not be found. May 12 11:54:38.736147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:54:38.736147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:54:38.736147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:54:38.736147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:54:38.736147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:54:38.736147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:54:38.736147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:54:38.736147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:54:38.736147 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:54:38.737771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:54:38.737771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:54:38.737771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:54:38.737771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:54:38.737771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:54:38.737771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:54:38.737771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:54:38.737771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d747a75-e74d-4c41-9707-aee578ce2d01 could not be found. May 12 11:54:38.737771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:54:38.737771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:54:38.737771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:54:38.737771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:54:38.737771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:54:38.737771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:54:38.737771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:54:38.737771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:54:38.737771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d747a75-e74d-4c41-9707-aee578ce2d01 could not be found. May 12 11:54:38.737771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:54:38.739260 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-adff15f3-5a7f-403e-8eb4-7c00b26857d8 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Returning 404 to user: Instance 8d747a75-e74d-4c41-9707-aee578ce2d01 could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:54:38.739260 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-adff15f3-5a7f-403e-8eb4-7c00b26857d8 tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01" status: 404 len: 111 microversion: 2.1 time: 0.030206 May 12 11:54:38.739260 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 474/943] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:54:38 2022] GET /compute/v2.1/servers/8d747a75-e74d-4c41-9707-aee578ce2d01 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:54:38.887181 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-4ed1201e-628c-4d78-beca-d9baeae7c4be tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] Calling method '.version_select at 0x7f29f1cd05e0>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:38.911618 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-4ed1201e-628c-4d78-beca-d9baeae7c4be tempest-TestShelveInstance-1499725121 tempest-TestShelveInstance-1499725121-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-73243958" status: 202 len: 0 microversion: 2.1 time: 0.028085 May 12 11:54:38.913000 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 470/944] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 12 11:54:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-73243958 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:54:39.085121 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-40ba39cc-2cbe-4dea-bad7-a1503abe0cca req-198a070c-e2a2-4060-b156-1a2067b29874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d", "name": "network-vif-plugged", "status": "completed", "tag": "9e40bffb-6790-40e2-907b-99ec56c50c04"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:54:39.096398 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-40ba39cc-2cbe-4dea-bad7-a1503abe0cca req-198a070c-e2a2-4060-b156-1a2067b29874 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:39.096918 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-40ba39cc-2cbe-4dea-bad7-a1503abe0cca req-198a070c-e2a2-4060-b156-1a2067b29874 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:39.109892 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-40ba39cc-2cbe-4dea-bad7-a1503abe0cca req-198a070c-e2a2-4060-b156-1a2067b29874 service nova] Creating event network-vif-plugged:9e40bffb-6790-40e2-907b-99ec56c50c04 for instance 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d on hv-cinder-80473 May 12 11:54:39.115071 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-40ba39cc-2cbe-4dea-bad7-a1503abe0cca req-198a070c-e2a2-4060-b156-1a2067b29874 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033771 May 12 11:54:39.115989 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 475/945] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:54:39.406853 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-414730ba-c638-4867-94ff-0405a96f9277 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:39.407468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-414730ba-c638-4867-94ff-0405a96f9277 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:39.413323 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-414730ba-c638-4867-94ff-0405a96f9277 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:39.413805 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-414730ba-c638-4867-94ff-0405a96f9277 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:39.414736 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-414730ba-c638-4867-94ff-0405a96f9277 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:39.415177 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-414730ba-c638-4867-94ff-0405a96f9277 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:39.544235 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-414730ba-c638-4867-94ff-0405a96f9277 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:54:39.551424 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-414730ba-c638-4867-94ff-0405a96f9277 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d" status: 200 len: 1364 microversion: 2.1 time: 0.148956 May 12 11:54:39.551980 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 471/946] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:54:39 2022] GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:54:40.568642 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-e732a008-54ba-4446-8ce2-08590ab62513 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:40.569339 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-e732a008-54ba-4446-8ce2-08590ab62513 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:40.575478 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e732a008-54ba-4446-8ce2-08590ab62513 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:40.575928 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e732a008-54ba-4446-8ce2-08590ab62513 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:40.576689 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e732a008-54ba-4446-8ce2-08590ab62513 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:40.577742 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e732a008-54ba-4446-8ce2-08590ab62513 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:40.720683 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-e732a008-54ba-4446-8ce2-08590ab62513 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:54:40.729205 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-e732a008-54ba-4446-8ce2-08590ab62513 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d" status: 200 len: 1555 microversion: 2.1 time: 0.165170 May 12 11:54:40.733740 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 476/947] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:54:40 2022] GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:54:40.745777 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-56b27e07-f718-42d9-ba14-8b317be721d2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:54:40.746680 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-56b27e07-f718-42d9-ba14-8b317be721d2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:54:40.753722 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-56b27e07-f718-42d9-ba14-8b317be721d2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:40.754379 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-56b27e07-f718-42d9-ba14-8b317be721d2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:40.755263 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-56b27e07-f718-42d9-ba14-8b317be721d2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:40.755807 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-56b27e07-f718-42d9-ba14-8b317be721d2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:40.865962 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-56b27e07-f718-42d9-ba14-8b317be721d2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123999 May 12 11:54:40.866876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 472/948] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 12 11:54:40 2022] GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:54:41.908165 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-a94faa05-e94b-4b1d-80f4-2247b1c72082 req-7be77d37-3237-48d2-a1e4-c98cc9d4e49e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d", "tag": "9e40bffb-6790-40e2-907b-99ec56c50c04"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:54:41.918284 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-a94faa05-e94b-4b1d-80f4-2247b1c72082 req-7be77d37-3237-48d2-a1e4-c98cc9d4e49e service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:54:41.918898 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-a94faa05-e94b-4b1d-80f4-2247b1c72082 req-7be77d37-3237-48d2-a1e4-c98cc9d4e49e service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:54:41.931852 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-a94faa05-e94b-4b1d-80f4-2247b1c72082 req-7be77d37-3237-48d2-a1e4-c98cc9d4e49e service nova] Creating event network-changed:9e40bffb-6790-40e2-907b-99ec56c50c04 for instance 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d on hv-cinder-80473 May 12 11:54:41.937788 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-a94faa05-e94b-4b1d-80f4-2247b1c72082 req-7be77d37-3237-48d2-a1e4-c98cc9d4e49e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033421 May 12 11:54:41.941542 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 477/949] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:54:56.865602 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-10e4a208-47da-4ca0-b9e4-d6455df2e987 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Action: 'create', calling method: .version_select at 0x7f29f77ef0d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-219476055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU1zTB2sQr19Q+M5hWX6vxQ5j8hxKJPbtYMNghjmYuSKT9SJSaseZybWYD69fkxAWJPAEWY70KNYqePQvtKZmciokO2Z8jHQ/Guy8nBHZYXDXqIsZxE5iLsNyM8rPQmAg=="}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:54:56.879637 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-10e4a208-47da-4ca0-b9e4-d6455df2e987 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Getting quotas for project 7d148f892d044444b6be65537ba8b335. Resources: {'key_pairs'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:54:56.883416 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-10e4a208-47da-4ca0-b9e4-d6455df2e987 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Getting quotas for user f6b3ad012ab1404b88e4b36c80a02a05 and project 7d148f892d044444b6be65537ba8b335. Resources: {'key_pairs'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:54:56.905156 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-10e4a208-47da-4ca0-b9e4-d6455df2e987 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.196798 May 12 11:54:56.905934 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 473/950] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 12 11:54:56 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:54:59.890092 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 11:54:59.890684 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Thu May 12 11:54:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 11:55:13.042209 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-5db7298d-e866-417a-b2d9-627310ea3c13 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1046657098", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-219476055", "security_groups": [{"name": "tempest-secgroup-smoke-1098863337"}], "block_device_mapping_v2": [{"uuid": "a70e7037-c337-4669-abdb-e067fb0917fe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2251d509-6705-4760-a42b-7398b2cf420e"}]}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:55:13.252562 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.network.neutron [None req-5db7298d-e866-417a-b2d9-627310ea3c13 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] validate_networks() for [('2251d509-6705-4760-a42b-7398b2cf420e', None, None, None, None, None)] {{(pid=123508) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 11:55:13.707125 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-5db7298d-e866-417a-b2d9-627310ea3c13 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Flavor limits 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 11:55:13.707554 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-5db7298d-e866-417a-b2d9-627310ea3c13 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Image limits 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 11:55:13.708033 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-5db7298d-e866-417a-b2d9-627310ea3c13 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Flavor pref 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 11:55:13.708450 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-5db7298d-e866-417a-b2d9-627310ea3c13 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Image pref 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 11:55:13.708887 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-5db7298d-e866-417a-b2d9-627310ea3c13 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 11:55:13.717803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5db7298d-e866-417a-b2d9-627310ea3c13 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:13.718261 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5db7298d-e866-417a-b2d9-627310ea3c13 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:13.719070 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5db7298d-e866-417a-b2d9-627310ea3c13 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:13.719513 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5db7298d-e866-417a-b2d9-627310ea3c13 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:13.736087 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-5db7298d-e866-417a-b2d9-627310ea3c13 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Getting quotas for project 7d148f892d044444b6be65537ba8b335. Resources: {'ram', 'cores', 'instances'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:55:13.739978 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-5db7298d-e866-417a-b2d9-627310ea3c13 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Getting quotas for user f6b3ad012ab1404b88e4b36c80a02a05 and project 7d148f892d044444b6be65537ba8b335. Resources: {'ram', 'cores', 'instances'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:55:13.796298 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-5db7298d-e866-417a-b2d9-627310ea3c13 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Going to run 1 instances... {{(pid=123508) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 11:55:13.799079 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-5db7298d-e866-417a-b2d9-627310ea3c13 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a70e7037-c337-4669-abdb-e067fb0917fe',volume_size=None,volume_type=None)] {{(pid=123508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 11:55:13.922782 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-5db7298d-e866-417a-b2d9-627310ea3c13 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.884804 May 12 11:55:13.923424 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 478/951] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 12 11:55:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 11:55:13.934143 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-e5f948d6-9430-4913-9d99-8fb6ac269072 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:13.934761 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-e5f948d6-9430-4913-9d99-8fb6ac269072 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:14.040290 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-e5f948d6-9430-4913-9d99-8fb6ac269072 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:14.047779 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-e5f948d6-9430-4913-9d99-8fb6ac269072 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab" status: 200 len: 1094 microversion: 2.1 time: 0.117431 May 12 11:55:14.048340 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 474/952] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:13 2022] GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab => generated 1094 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:15.065400 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-e788d9f3-281f-4bda-80b6-8f5e814f2dbd tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:15.066056 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-e788d9f3-281f-4bda-80b6-8f5e814f2dbd tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:15.073286 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e788d9f3-281f-4bda-80b6-8f5e814f2dbd tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:15.073812 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e788d9f3-281f-4bda-80b6-8f5e814f2dbd tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:15.074594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e788d9f3-281f-4bda-80b6-8f5e814f2dbd tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:15.075035 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e788d9f3-281f-4bda-80b6-8f5e814f2dbd tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:15.167754 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-e788d9f3-281f-4bda-80b6-8f5e814f2dbd tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:15.175185 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-e788d9f3-281f-4bda-80b6-8f5e814f2dbd tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab" status: 200 len: 1210 microversion: 2.1 time: 0.114684 May 12 11:55:15.175752 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 479/953] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:15 2022] GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab => generated 1210 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:16.193564 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-485ab15e-9703-4d6f-aeb9-f82eaedbef7d tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:16.194442 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-485ab15e-9703-4d6f-aeb9-f82eaedbef7d tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:16.201203 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-485ab15e-9703-4d6f-aeb9-f82eaedbef7d tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:16.201660 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-485ab15e-9703-4d6f-aeb9-f82eaedbef7d tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:16.202511 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-485ab15e-9703-4d6f-aeb9-f82eaedbef7d tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:16.202952 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-485ab15e-9703-4d6f-aeb9-f82eaedbef7d tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:16.330391 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-fb393b04-755b-49c5-a43d-afade0646075 req-ec50b48c-e977-474d-9849-4c0dc857bff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08861685-923b-4ae7-ac93-e58799f637ab", "tag": "f39ce636-63c4-4a0e-a9ba-46a28d7f11e1"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:55:16.344751 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-fb393b04-755b-49c5-a43d-afade0646075 req-ec50b48c-e977-474d-9849-4c0dc857bff2 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:16.346012 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-485ab15e-9703-4d6f-aeb9-f82eaedbef7d tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:16.348606 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-fb393b04-755b-49c5-a43d-afade0646075 req-ec50b48c-e977-474d-9849-4c0dc857bff2 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:16.354320 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-485ab15e-9703-4d6f-aeb9-f82eaedbef7d tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab" status: 200 len: 1266 microversion: 2.1 time: 0.165496 May 12 11:55:16.355158 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 475/954] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:16 2022] GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:16.362478 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-fb393b04-755b-49c5-a43d-afade0646075 req-ec50b48c-e977-474d-9849-4c0dc857bff2 service nova] Creating event network-changed:f39ce636-63c4-4a0e-a9ba-46a28d7f11e1 for instance 08861685-923b-4ae7-ac93-e58799f637ab on hv-cinder-80473 May 12 11:55:16.371713 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-fb393b04-755b-49c5-a43d-afade0646075 req-ec50b48c-e977-474d-9849-4c0dc857bff2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045563 May 12 11:55:16.372640 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 480/955] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:55:17.371694 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-2c1104ac-edb6-499c-a6c7-c791d47d9dda tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:17.372303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-2c1104ac-edb6-499c-a6c7-c791d47d9dda tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:17.378927 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2c1104ac-edb6-499c-a6c7-c791d47d9dda tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:17.379382 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2c1104ac-edb6-499c-a6c7-c791d47d9dda tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:17.380169 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2c1104ac-edb6-499c-a6c7-c791d47d9dda tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:17.380608 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2c1104ac-edb6-499c-a6c7-c791d47d9dda tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:17.512045 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-2c1104ac-edb6-499c-a6c7-c791d47d9dda tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:17.520170 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-2c1104ac-edb6-499c-a6c7-c791d47d9dda tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab" status: 200 len: 1266 microversion: 2.1 time: 0.152307 May 12 11:55:17.520731 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 476/956] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:17 2022] GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:18.539575 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-60a73df0-27c6-4d74-9b2e-869286c8c7d0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:18.540275 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-60a73df0-27c6-4d74-9b2e-869286c8c7d0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:18.546432 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-60a73df0-27c6-4d74-9b2e-869286c8c7d0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:18.546881 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-60a73df0-27c6-4d74-9b2e-869286c8c7d0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:18.547648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-60a73df0-27c6-4d74-9b2e-869286c8c7d0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:18.548085 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-60a73df0-27c6-4d74-9b2e-869286c8c7d0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:18.676035 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-60a73df0-27c6-4d74-9b2e-869286c8c7d0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:18.683373 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-60a73df0-27c6-4d74-9b2e-869286c8c7d0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab" status: 200 len: 1266 microversion: 2.1 time: 0.149555 May 12 11:55:18.683940 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 481/957] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:18 2022] GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:19.628044 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-7c419473-6082-4259-b265-9783eee880cd tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:19.628569 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-7c419473-6082-4259-b265-9783eee880cd tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:19.634938 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7c419473-6082-4259-b265-9783eee880cd tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:19.635393 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7c419473-6082-4259-b265-9783eee880cd tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:19.636155 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7c419473-6082-4259-b265-9783eee880cd tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:19.636589 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7c419473-6082-4259-b265-9783eee880cd tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:19.661010 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-7c419473-6082-4259-b265-9783eee880cd tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d/ips" status: 200 len: 151 microversion: 2.1 time: 0.037328 May 12 11:55:19.661589 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 477/958] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 12 11:55:19 2022] GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:55:19.700123 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-d10edd52-7d09-4e78-990a-ea960950bb31 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:19.700765 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d10edd52-7d09-4e78-990a-ea960950bb31 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:19.707785 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d10edd52-7d09-4e78-990a-ea960950bb31 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:19.708233 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d10edd52-7d09-4e78-990a-ea960950bb31 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:19.709001 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d10edd52-7d09-4e78-990a-ea960950bb31 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:19.709438 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d10edd52-7d09-4e78-990a-ea960950bb31 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:19.845626 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-d10edd52-7d09-4e78-990a-ea960950bb31 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:19.853122 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-d10edd52-7d09-4e78-990a-ea960950bb31 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab" status: 200 len: 1266 microversion: 2.1 time: 0.156800 May 12 11:55:19.853684 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 482/959] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:19 2022] GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:20.870243 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-bf6ca689-0b5f-4e81-b554-fb426a3b41d2 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:20.870779 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-bf6ca689-0b5f-4e81-b554-fb426a3b41d2 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:20.877831 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bf6ca689-0b5f-4e81-b554-fb426a3b41d2 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:20.878288 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bf6ca689-0b5f-4e81-b554-fb426a3b41d2 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:20.879057 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bf6ca689-0b5f-4e81-b554-fb426a3b41d2 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:20.879498 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-bf6ca689-0b5f-4e81-b554-fb426a3b41d2 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:20.970930 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-0f5c5c20-e1a1-4ebe-96c4-3ff6365a7e00 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "823a18e5-72d2-4762-8763-ca5b1a13cff5"}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:55:20.971996 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-0f5c5c20-e1a1-4ebe-96c4-3ff6365a7e00 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:20.978254 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0f5c5c20-e1a1-4ebe-96c4-3ff6365a7e00 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:20.978708 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0f5c5c20-e1a1-4ebe-96c4-3ff6365a7e00 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:20.979490 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0f5c5c20-e1a1-4ebe-96c4-3ff6365a7e00 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:20.979930 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0f5c5c20-e1a1-4ebe-96c4-3ff6365a7e00 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:21.007550 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-bf6ca689-0b5f-4e81-b554-fb426a3b41d2 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:21.014811 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-bf6ca689-0b5f-4e81-b554-fb426a3b41d2 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab" status: 200 len: 1266 microversion: 2.1 time: 0.148403 May 12 11:55:21.015381 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 478/960] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:20 2022] GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:21.220456 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-0f5c5c20-e1a1-4ebe-96c4-3ff6365a7e00 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "POST /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253598 May 12 11:55:21.221075 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 483/961] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 12 11:55:20 2022] POST /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:55:22.032577 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-3eb82338-318d-42ef-83fb-569258919b53 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:22.033114 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-3eb82338-318d-42ef-83fb-569258919b53 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:22.040472 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3eb82338-318d-42ef-83fb-569258919b53 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:22.040919 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3eb82338-318d-42ef-83fb-569258919b53 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:22.041679 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3eb82338-318d-42ef-83fb-569258919b53 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:22.042151 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3eb82338-318d-42ef-83fb-569258919b53 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:22.166772 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-3eb82338-318d-42ef-83fb-569258919b53 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:22.174642 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-3eb82338-318d-42ef-83fb-569258919b53 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab" status: 200 len: 1266 microversion: 2.1 time: 0.146000 May 12 11:55:22.175195 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 479/962] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:22 2022] GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:23.192915 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-1f068e96-eb2f-41a2-9f23-8a77b4e31cf5 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:23.193595 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-1f068e96-eb2f-41a2-9f23-8a77b4e31cf5 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:23.199814 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1f068e96-eb2f-41a2-9f23-8a77b4e31cf5 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:23.200266 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1f068e96-eb2f-41a2-9f23-8a77b4e31cf5 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:23.201038 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1f068e96-eb2f-41a2-9f23-8a77b4e31cf5 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:23.201483 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1f068e96-eb2f-41a2-9f23-8a77b4e31cf5 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:23.333494 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-1f068e96-eb2f-41a2-9f23-8a77b4e31cf5 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:23.340789 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-1f068e96-eb2f-41a2-9f23-8a77b4e31cf5 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab" status: 200 len: 1266 microversion: 2.1 time: 0.153156 May 12 11:55:23.341346 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 484/963] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:23 2022] GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:24.357630 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-6be4965d-b2e9-4709-8814-8851ebc0be5a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:24.358265 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-6be4965d-b2e9-4709-8814-8851ebc0be5a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:24.364795 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6be4965d-b2e9-4709-8814-8851ebc0be5a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:24.365245 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6be4965d-b2e9-4709-8814-8851ebc0be5a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:24.366038 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6be4965d-b2e9-4709-8814-8851ebc0be5a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:24.366474 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-6be4965d-b2e9-4709-8814-8851ebc0be5a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:24.500487 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-6be4965d-b2e9-4709-8814-8851ebc0be5a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:24.507839 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-6be4965d-b2e9-4709-8814-8851ebc0be5a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab" status: 200 len: 1266 microversion: 2.1 time: 0.154019 May 12 11:55:24.508394 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 480/964] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:24 2022] GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:25.524211 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-9e84e39e-df87-4416-b596-daa0598a0a87 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:25.524863 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-9e84e39e-df87-4416-b596-daa0598a0a87 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:25.531260 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9e84e39e-df87-4416-b596-daa0598a0a87 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:25.532250 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9e84e39e-df87-4416-b596-daa0598a0a87 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:25.533022 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9e84e39e-df87-4416-b596-daa0598a0a87 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:25.533463 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9e84e39e-df87-4416-b596-daa0598a0a87 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:25.663622 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-9e84e39e-df87-4416-b596-daa0598a0a87 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:25.670455 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-9e84e39e-df87-4416-b596-daa0598a0a87 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab" status: 200 len: 1266 microversion: 2.1 time: 0.150055 May 12 11:55:25.671026 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 485/965] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:25 2022] GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:26.687671 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-30493c2a-a412-4353-aee3-75fc4fd385e5 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:26.688198 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-30493c2a-a412-4353-aee3-75fc4fd385e5 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:26.694495 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-30493c2a-a412-4353-aee3-75fc4fd385e5 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:26.694942 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-30493c2a-a412-4353-aee3-75fc4fd385e5 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:26.695869 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-30493c2a-a412-4353-aee3-75fc4fd385e5 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:26.696568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-30493c2a-a412-4353-aee3-75fc4fd385e5 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:26.824755 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-30493c2a-a412-4353-aee3-75fc4fd385e5 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:26.832483 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-30493c2a-a412-4353-aee3-75fc4fd385e5 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab" status: 200 len: 1266 microversion: 2.1 time: 0.148721 May 12 11:55:26.833038 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 481/966] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:26 2022] GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:27.385245 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-bc92d88b-342a-43e0-86e1-e5f537d9352d req-d1a4438e-bf11-4d28-b10f-3b06d9abc12c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08861685-923b-4ae7-ac93-e58799f637ab", "name": "network-vif-plugged", "status": "completed", "tag": "f39ce636-63c4-4a0e-a9ba-46a28d7f11e1"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:55:27.394295 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-bc92d88b-342a-43e0-86e1-e5f537d9352d req-d1a4438e-bf11-4d28-b10f-3b06d9abc12c service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:27.394994 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-bc92d88b-342a-43e0-86e1-e5f537d9352d req-d1a4438e-bf11-4d28-b10f-3b06d9abc12c service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:27.406016 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-bc92d88b-342a-43e0-86e1-e5f537d9352d req-d1a4438e-bf11-4d28-b10f-3b06d9abc12c service nova] Creating event network-vif-plugged:f39ce636-63c4-4a0e-a9ba-46a28d7f11e1 for instance 08861685-923b-4ae7-ac93-e58799f637ab on hv-cinder-80473 May 12 11:55:27.410828 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-bc92d88b-342a-43e0-86e1-e5f537d9352d req-d1a4438e-bf11-4d28-b10f-3b06d9abc12c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029317 May 12 11:55:27.411417 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 486/967] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:55:27.848570 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-a057e1b3-802f-4eec-9548-41b846fb2112 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:27.849184 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-a057e1b3-802f-4eec-9548-41b846fb2112 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:27.855476 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a057e1b3-802f-4eec-9548-41b846fb2112 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:27.855926 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a057e1b3-802f-4eec-9548-41b846fb2112 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:27.856691 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a057e1b3-802f-4eec-9548-41b846fb2112 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:27.857123 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-a057e1b3-802f-4eec-9548-41b846fb2112 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:27.986597 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-a057e1b3-802f-4eec-9548-41b846fb2112 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:27.993791 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-a057e1b3-802f-4eec-9548-41b846fb2112 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab" status: 200 len: 1266 microversion: 2.1 time: 0.148932 May 12 11:55:27.994277 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 482/968] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:27 2022] GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:28.696397 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b666cf11-4171-4a05-ada9-a046f4aa9090 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "823a18e5-72d2-4762-8763-ca5b1a13cff5"}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:55:28.697577 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-b666cf11-4171-4a05-ada9-a046f4aa9090 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:28.704315 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b666cf11-4171-4a05-ada9-a046f4aa9090 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:28.704771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b666cf11-4171-4a05-ada9-a046f4aa9090 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:28.705533 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b666cf11-4171-4a05-ada9-a046f4aa9090 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:28.705999 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b666cf11-4171-4a05-ada9-a046f4aa9090 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:28.783953 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-b666cf11-4171-4a05-ada9-a046f4aa9090 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] HTTP exception thrown: Invalid volume: volume 823a18e5-72d2-4762-8763-ca5b1a13cff5 is already attached to instances: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d May 12 11:55:28.785737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b666cf11-4171-4a05-ada9-a046f4aa9090 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Request method failure captured: May 12 11:55:28.785737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: POST /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d/os-volume_attachments HTTP/1.1 May 12 11:55:28.785737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:55:28.785737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:55:28.785737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:55:28.785737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 74 May 12 11:55:28.785737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:55:28.785737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:55:28.785737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:55:28.785737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:55:28.785737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPT8DEqCl4bX1_JU4Gitc3XogKR68P5YOrihZb3A5s6OOjrNceKy4j0AAlhI1OykUdJ79F3DICwWoBGKYb9sTlx-KD1LIJeTeUwhzJM4K7lZwKUqOtx8Qx0TugCbusjZJDLOtH8-zZzIn16n9DfmdO2XxMASJeCEJXf-EhUNFNzhC9Q May 12 11:55:28.785737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:55:28.785737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:55:28.785737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:55:28.785737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:55:28.785737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:55:28.785737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:55:28.785737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:55:28.785737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:55:28.785737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:55:28.785737 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:55:28.787192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b284fcbfe0214240a616a6d68cedfed2", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:55:28.787192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:55:28.787192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:55:28.787192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:55:28.787192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:55:28.787192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:55:28.787192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:55:28.787192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 61fcd9d503734952b0ea9ec6ef96be6c May 12 11:55:28.787192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:55:28.787192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: May 12 11:55:28.787192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {"volumeAttachment": {"volumeId": "823a18e5-72d2-4762-8763-ca5b1a13cff5"}} May 12 11:55:28.787192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:55:28.788486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Invalid volume: volume 823a18e5-72d2-4762-8763-ca5b1a13cff5 is already attached to instances: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d May 12 11:55:28.788486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'server_id': '7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d', 'body': {'volumeAttachment': {'volumeId': '823a18e5-72d2-4762-8763-ca5b1a13cff5'}}} May 12 11:55:28.788486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:55:28.788486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:55:28.788486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 11:55:28.788486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 11:55:28.788486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 11:55:28.788486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 11:55:28.788486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 11:55:28.788486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 11:55:28.788486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 12 11:55:28.788486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 12 11:55:28.788486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 12 11:55:28.788486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 12 11:55:28.788486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 823a18e5-72d2-4762-8763-ca5b1a13cff5 is already attached to instances: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d May 12 11:55:28.788486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:55:28.788486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:55:28.788486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:55:28.788486 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:55:28.789729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:55:28.789729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:55:28.789729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:55:28.789729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:55:28.789729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:55:28.789729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:55:28.789729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 11:55:28.789729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 11:55:28.789729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 11:55:28.789729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 11:55:28.789729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 11:55:28.789729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 11:55:28.789729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 12 11:55:28.789729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 11:55:28.789729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 823a18e5-72d2-4762-8763-ca5b1a13cff5 is already attached to instances: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d May 12 11:55:28.789729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:55:28.789729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:55:28.789729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:55:28.789729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:55:28.789729 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:55:28.792676 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:55:28.792676 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:55:28.792676 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:55:28.792676 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 823a18e5-72d2-4762-8763-ca5b1a13cff5 is already attached to instances: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d May 12 11:55:28.792676 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:55:28.792676 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b666cf11-4171-4a05-ada9-a046f4aa9090 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Returning 400 to user: Invalid volume: volume 823a18e5-72d2-4762-8763-ca5b1a13cff5 is already attached to instances: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:55:28.792676 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-b666cf11-4171-4a05-ada9-a046f4aa9090 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "POST /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095612 May 12 11:55:28.792676 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 487/969] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 12 11:55:28 2022] POST /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 11:55:28.849594 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-165920c6-9e2b-4d98-8ef2-82d587fc7f8b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:28.850125 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-165920c6-9e2b-4d98-8ef2-82d587fc7f8b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:28.856453 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-165920c6-9e2b-4d98-8ef2-82d587fc7f8b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:28.856894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-165920c6-9e2b-4d98-8ef2-82d587fc7f8b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:28.857649 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-165920c6-9e2b-4d98-8ef2-82d587fc7f8b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:28.858122 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-165920c6-9e2b-4d98-8ef2-82d587fc7f8b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:28.933514 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.objects.instance [None req-165920c6-9e2b-4d98-8ef2-82d587fc7f8b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lazy-loading 'services' on Instance uuid 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d {{(pid=123507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:55:29.003620 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-165920c6-9e2b-4d98-8ef2-82d587fc7f8b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d/os-volume_attachments/823a18e5-72d2-4762-8763-ca5b1a13cff5" status: 202 len: 0 microversion: 2.1 time: 0.157702 May 12 11:55:29.007140 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 483/970] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 12 11:55:28 2022] DELETE /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d/os-volume_attachments/823a18e5-72d2-4762-8763-ca5b1a13cff5 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 11:55:29.010986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-82446597-dfdd-4650-8581-7794fa8adedc tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:29.011553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-82446597-dfdd-4650-8581-7794fa8adedc tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:29.012412 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-eff5e59b-1798-4b97-b380-949069c10f30 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:29.013471 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-eff5e59b-1798-4b97-b380-949069c10f30 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:29.018911 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-82446597-dfdd-4650-8581-7794fa8adedc tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:29.019368 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-82446597-dfdd-4650-8581-7794fa8adedc tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:29.020009 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-eff5e59b-1798-4b97-b380-949069c10f30 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:29.020146 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-82446597-dfdd-4650-8581-7794fa8adedc tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:29.020462 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-eff5e59b-1798-4b97-b380-949069c10f30 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:29.020588 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-82446597-dfdd-4650-8581-7794fa8adedc tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:29.021227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-eff5e59b-1798-4b97-b380-949069c10f30 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:29.021668 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-eff5e59b-1798-4b97-b380-949069c10f30 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:29.056322 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-eff5e59b-1798-4b97-b380-949069c10f30 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043601 May 12 11:55:29.056322 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 484/971] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 12 11:55:29 2022] GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:55:29.153211 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-82446597-dfdd-4650-8581-7794fa8adedc tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:29.161025 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-82446597-dfdd-4650-8581-7794fa8adedc tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab" status: 200 len: 1453 microversion: 2.1 time: 0.154095 May 12 11:55:29.161612 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 488/972] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:29 2022] GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:29.179148 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-8c2e5eab-f1f9-413f-ab78-cb4aceb8a39f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:29.180197 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-8c2e5eab-f1f9-413f-ab78-cb4aceb8a39f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:29.190049 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8c2e5eab-f1f9-413f-ab78-cb4aceb8a39f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:29.190577 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8c2e5eab-f1f9-413f-ab78-cb4aceb8a39f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:29.191353 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8c2e5eab-f1f9-413f-ab78-cb4aceb8a39f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:29.191782 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-8c2e5eab-f1f9-413f-ab78-cb4aceb8a39f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:29.325661 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-8c2e5eab-f1f9-413f-ab78-cb4aceb8a39f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:29.333469 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-8c2e5eab-f1f9-413f-ab78-cb4aceb8a39f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab" status: 200 len: 1453 microversion: 2.1 time: 0.160139 May 12 11:55:29.334062 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 485/973] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:29 2022] GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:30.063996 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-98435568-5f02-41a8-baaa-50139bd670bc tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:30.064887 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-98435568-5f02-41a8-baaa-50139bd670bc tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:30.071189 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-98435568-5f02-41a8-baaa-50139bd670bc tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:30.071640 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-98435568-5f02-41a8-baaa-50139bd670bc tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:30.072416 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-98435568-5f02-41a8-baaa-50139bd670bc tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:30.072853 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-98435568-5f02-41a8-baaa-50139bd670bc tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:30.104539 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-98435568-5f02-41a8-baaa-50139bd670bc tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044529 May 12 11:55:30.105107 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 489/974] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 12 11:55:30 2022] GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 11:55:30.161768 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-29ee4e1f-9d9a-4dee-8177-adea3544992e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:30.162312 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-29ee4e1f-9d9a-4dee-8177-adea3544992e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:30.168603 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-29ee4e1f-9d9a-4dee-8177-adea3544992e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:30.169060 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-29ee4e1f-9d9a-4dee-8177-adea3544992e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:30.169882 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-29ee4e1f-9d9a-4dee-8177-adea3544992e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:30.170328 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-29ee4e1f-9d9a-4dee-8177-adea3544992e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:30.195928 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-29ee4e1f-9d9a-4dee-8177-adea3544992e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Going to try to terminate instance {{(pid=123507) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 11:55:30.271885 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-29ee4e1f-9d9a-4dee-8177-adea3544992e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d" status: 204 len: 0 microversion: 2.1 time: 0.113905 May 12 11:55:30.273099 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 486/975] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:55:30 2022] DELETE /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 11:55:30.281091 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-06eb8aa3-0f79-4029-8ca5-98999a94297b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:30.281930 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-06eb8aa3-0f79-4029-8ca5-98999a94297b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:30.288555 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-06eb8aa3-0f79-4029-8ca5-98999a94297b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:30.289014 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-06eb8aa3-0f79-4029-8ca5-98999a94297b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:30.289957 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-06eb8aa3-0f79-4029-8ca5-98999a94297b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:30.290436 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-06eb8aa3-0f79-4029-8ca5-98999a94297b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:30.420787 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-06eb8aa3-0f79-4029-8ca5-98999a94297b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:30.428112 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-06eb8aa3-0f79-4029-8ca5-98999a94297b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d" status: 200 len: 1680 microversion: 2.1 time: 0.151230 May 12 11:55:30.428685 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 490/976] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:30 2022] GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:31.011537 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-5c7010b2-c090-44ca-85da-d9b971da9748 req-56a789cb-0290-4281-bab1-26e3332ca75a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08861685-923b-4ae7-ac93-e58799f637ab", "tag": "f39ce636-63c4-4a0e-a9ba-46a28d7f11e1"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:55:31.019479 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-5c7010b2-c090-44ca-85da-d9b971da9748 req-56a789cb-0290-4281-bab1-26e3332ca75a service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:31.020018 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-5c7010b2-c090-44ca-85da-d9b971da9748 req-56a789cb-0290-4281-bab1-26e3332ca75a service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:31.030659 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-5c7010b2-c090-44ca-85da-d9b971da9748 req-56a789cb-0290-4281-bab1-26e3332ca75a service nova] Creating event network-changed:f39ce636-63c4-4a0e-a9ba-46a28d7f11e1 for instance 08861685-923b-4ae7-ac93-e58799f637ab on hv-cinder-80473 May 12 11:55:31.035476 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-5c7010b2-c090-44ca-85da-d9b971da9748 req-56a789cb-0290-4281-bab1-26e3332ca75a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027923 May 12 11:55:31.036216 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 487/977] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:55:31.444423 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b96c94a3-8529-4300-b818-d1276f6f95c8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:31.445027 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-b96c94a3-8529-4300-b818-d1276f6f95c8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:31.451446 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b96c94a3-8529-4300-b818-d1276f6f95c8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:31.451895 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b96c94a3-8529-4300-b818-d1276f6f95c8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:31.452660 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b96c94a3-8529-4300-b818-d1276f6f95c8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:31.453091 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b96c94a3-8529-4300-b818-d1276f6f95c8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:31.607306 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-b96c94a3-8529-4300-b818-d1276f6f95c8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:31.615592 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-b96c94a3-8529-4300-b818-d1276f6f95c8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d" status: 200 len: 1680 microversion: 2.1 time: 0.175056 May 12 11:55:31.616522 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 491/978] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:31 2022] GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:32.633514 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-4e9d1544-35d4-457d-91e4-d8dd7e45b9cd tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:32.634248 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-4e9d1544-35d4-457d-91e4-d8dd7e45b9cd tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:32.640795 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4e9d1544-35d4-457d-91e4-d8dd7e45b9cd tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:32.641774 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4e9d1544-35d4-457d-91e4-d8dd7e45b9cd tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:32.642568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4e9d1544-35d4-457d-91e4-d8dd7e45b9cd tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:32.643013 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4e9d1544-35d4-457d-91e4-d8dd7e45b9cd tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:32.896343 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-4e9d1544-35d4-457d-91e4-d8dd7e45b9cd tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:32.904894 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-4e9d1544-35d4-457d-91e4-d8dd7e45b9cd tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d" status: 200 len: 1613 microversion: 2.1 time: 0.276021 May 12 11:55:32.905635 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 488/979] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:32 2022] GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d => generated 1613 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:33.084454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-989290ec-893d-4bd9-b28e-9a909960932e req-ddad3bb5-6b90-4b13-8f82-da07357bc7d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d", "name": "network-vif-deleted", "tag": "9e40bffb-6790-40e2-907b-99ec56c50c04"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:55:33.094826 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-989290ec-893d-4bd9-b28e-9a909960932e req-ddad3bb5-6b90-4b13-8f82-da07357bc7d1 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:33.095276 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-989290ec-893d-4bd9-b28e-9a909960932e req-ddad3bb5-6b90-4b13-8f82-da07357bc7d1 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:33.109241 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-989290ec-893d-4bd9-b28e-9a909960932e req-ddad3bb5-6b90-4b13-8f82-da07357bc7d1 service nova] Creating event network-vif-deleted:9e40bffb-6790-40e2-907b-99ec56c50c04 for instance 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d on hv-cinder-80473 May 12 11:55:33.114648 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-989290ec-893d-4bd9-b28e-9a909960932e req-ddad3bb5-6b90-4b13-8f82-da07357bc7d1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033857 May 12 11:55:33.115251 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 492/980] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:55:33.921315 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-9ddb9529-79b7-46fa-940a-300b0fb57959 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:33.921963 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-9ddb9529-79b7-46fa-940a-300b0fb57959 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:33.928624 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9ddb9529-79b7-46fa-940a-300b0fb57959 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:33.929074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9ddb9529-79b7-46fa-940a-300b0fb57959 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:33.929899 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9ddb9529-79b7-46fa-940a-300b0fb57959 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:33.930338 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9ddb9529-79b7-46fa-940a-300b0fb57959 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:33.944619 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-9ddb9529-79b7-46fa-940a-300b0fb57959 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] HTTP exception thrown: Instance 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d could not be found. May 12 11:55:33.946327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-9ddb9529-79b7-46fa-940a-300b0fb57959 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Request method failure captured: May 12 11:55:33.946327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d HTTP/1.1 May 12 11:55:33.946327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:55:33.946327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:55:33.946327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:55:33.946327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 0 May 12 11:55:33.946327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:55:33.946327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:55:33.946327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:55:33.946327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:55:33.946327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPT8DEqCl4bX1_JU4Gitc3XogKR68P5YOrihZb3A5s6OOjrNceKy4j0AAlhI1OykUdJ79F3DICwWoBGKYb9sTlx-KD1LIJeTeUwhzJM4K7lZwKUqOtx8Qx0TugCbusjZJDLOtH8-zZzIn16n9DfmdO2XxMASJeCEJXf-EhUNFNzhC9Q May 12 11:55:33.946327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:55:33.946327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:55:33.946327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:55:33.946327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:55:33.946327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:55:33.946327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:55:33.946327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:55:33.946327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:55:33.946327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:55:33.946327 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:55:33.948018 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b284fcbfe0214240a616a6d68cedfed2", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:55:33.948018 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:55:33.948018 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:55:33.948018 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:55:33.948018 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:55:33.948018 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:55:33.948018 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:55:33.948018 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: 61fcd9d503734952b0ea9ec6ef96be6c May 12 11:55:33.948018 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:55:33.948018 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: > May 12 11:55:33.948018 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Instance 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d could not be found. May 12 11:55:33.948018 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'id': '7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d'} May 12 11:55:33.948876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:55:33.948876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:55:33.948876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:55:33.948876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:55:33.948876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:55:33.948876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:55:33.948876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:55:33.948876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:55:33.948876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:55:33.948876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:55:33.948876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d could not be found. May 12 11:55:33.948876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:55:33.948876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:55:33.948876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:55:33.948876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:55:33.948876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:55:33.948876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:55:33.948876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:55:33.948876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:55:33.948876 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:55:33.950303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:55:33.950303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:55:33.950303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:55:33.950303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:55:33.950303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:55:33.950303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:55:33.950303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:55:33.950303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d could not be found. May 12 11:55:33.950303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:55:33.950303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:55:33.950303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:55:33.950303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:55:33.950303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:55:33.950303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:55:33.950303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:55:33.950303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:55:33.950303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d could not be found. May 12 11:55:33.950303 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:55:33.951464 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-9ddb9529-79b7-46fa-940a-300b0fb57959 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Returning 404 to user: Instance 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d could not be found. {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:55:33.951464 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-9ddb9529-79b7-46fa-940a-300b0fb57959 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d" status: 404 len: 111 microversion: 2.1 time: 0.030241 May 12 11:55:33.951464 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 489/981] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:33 2022] GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:55:33.957772 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-f8ed6c41-a951-4d98-a29a-119f8613a629 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '.version_select at 0x7f29f267f820>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:33.975589 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-f8ed6c41-a951-4d98-a29a-119f8613a629 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-5133871" status: 202 len: 0 microversion: 2.1 time: 0.022549 May 12 11:55:33.976165 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 493/982] 10.222.0.58 () {58 vars in 1211 bytes} [Thu May 12 11:55:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-5133871 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:55:34.866754 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-59f83d84-cfda-49f7-9e67-d17e9d1fc8a7 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Action: 'create', calling method: .version_select at 0x7f29f1caf700>, body: {"keypair": {"name": "tempest-keypair-1776740030", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5S6Dwq5eVUsmXtuPTTH7TAlrThqjmZ7/qMiZB1/HEaywN6PbSPDNVWY4nxSiPEQk6ECifQWZ9G6TQl2/d6ztt0dHAbANaQCwbSFXrOlTcXmwjgO0Hknv8FauuzaU3/YQ=="}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:55:34.880162 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-59f83d84-cfda-49f7-9e67-d17e9d1fc8a7 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Getting quotas for project b284fcbfe0214240a616a6d68cedfed2. Resources: {'key_pairs'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:55:34.883872 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-59f83d84-cfda-49f7-9e67-d17e9d1fc8a7 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Getting quotas for user 61fcd9d503734952b0ea9ec6ef96be6c and project b284fcbfe0214240a616a6d68cedfed2. Resources: {'key_pairs'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:55:34.904766 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-59f83d84-cfda-49f7-9e67-d17e9d1fc8a7 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.041860 May 12 11:55:34.905331 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 490/983] 10.222.0.58 () {60 vars in 1158 bytes} [Thu May 12 11:55:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:55:36.166047 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-d762437a-c837-41ea-90a4-e2aeb64a42c3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-405509711", "imageRef": "576e8b7b-771b-47aa-89c6-ff04accc9bea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b35a8e2-7cac-4312-8515-92a011fa862b"}], "security_groups": [{"name": "tempest-securitygroup--193320777"}], "key_name": "tempest-keypair-1776740030", "user_data": "}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:55:36.266118 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.network.neutron [None req-d762437a-c837-41ea-90a4-e2aeb64a42c3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] validate_networks() for [('7b35a8e2-7cac-4312-8515-92a011fa862b', None, None, None, None, None)] {{(pid=123508) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 11:55:36.614161 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-d762437a-c837-41ea-90a4-e2aeb64a42c3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Flavor limits 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 11:55:36.614588 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-d762437a-c837-41ea-90a4-e2aeb64a42c3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Image limits 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 11:55:36.615089 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-d762437a-c837-41ea-90a4-e2aeb64a42c3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Flavor pref 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 11:55:36.615505 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-d762437a-c837-41ea-90a4-e2aeb64a42c3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Image pref 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 11:55:36.615918 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-d762437a-c837-41ea-90a4-e2aeb64a42c3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 11:55:36.624471 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d762437a-c837-41ea-90a4-e2aeb64a42c3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:36.624918 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d762437a-c837-41ea-90a4-e2aeb64a42c3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:36.626273 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d762437a-c837-41ea-90a4-e2aeb64a42c3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:36.626713 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d762437a-c837-41ea-90a4-e2aeb64a42c3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:36.643204 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-d762437a-c837-41ea-90a4-e2aeb64a42c3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Getting quotas for project b284fcbfe0214240a616a6d68cedfed2. Resources: {'ram', 'cores', 'instances'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:55:36.647069 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-d762437a-c837-41ea-90a4-e2aeb64a42c3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Getting quotas for user 61fcd9d503734952b0ea9ec6ef96be6c and project b284fcbfe0214240a616a6d68cedfed2. Resources: {'ram', 'cores', 'instances'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:55:36.657667 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d762437a-c837-41ea-90a4-e2aeb64a42c3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Going to run 1 instances... {{(pid=123508) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 11:55:36.659989 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d762437a-c837-41ea-90a4-e2aeb64a42c3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='576e8b7b-771b-47aa-89c6-ff04accc9bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 11:55:36.704311 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-d762437a-c837-41ea-90a4-e2aeb64a42c3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.542445 May 12 11:55:36.704975 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 494/984] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 12 11:55:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 11:55:36.715368 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-eda92682-7939-44a1-8556-4956da14706c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:36.715976 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-eda92682-7939-44a1-8556-4956da14706c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:36.772388 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-eda92682-7939-44a1-8556-4956da14706c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:36.778736 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-eda92682-7939-44a1-8556-4956da14706c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5" status: 200 len: 1241 microversion: 2.1 time: 0.067780 May 12 11:55:36.779296 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 491/985] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:36 2022] GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:37.797174 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-ade11677-16d5-4af2-81ab-9a71c7fdb74f tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:37.798281 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-ade11677-16d5-4af2-81ab-9a71c7fdb74f tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:37.805257 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ade11677-16d5-4af2-81ab-9a71c7fdb74f tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:37.806118 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ade11677-16d5-4af2-81ab-9a71c7fdb74f tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:37.807087 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ade11677-16d5-4af2-81ab-9a71c7fdb74f tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:37.807724 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-ade11677-16d5-4af2-81ab-9a71c7fdb74f tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:37.871843 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-ade11677-16d5-4af2-81ab-9a71c7fdb74f tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:37.879510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-ade11677-16d5-4af2-81ab-9a71c7fdb74f tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5" status: 200 len: 1311 microversion: 2.1 time: 0.087140 May 12 11:55:37.884417 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 495/986] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:37 2022] GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5 => generated 1311 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:38.896215 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-12008a57-6e35-4c4e-b16a-d16e2d1e8bc3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:38.896830 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-12008a57-6e35-4c4e-b16a-d16e2d1e8bc3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:38.903320 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-12008a57-6e35-4c4e-b16a-d16e2d1e8bc3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:38.903958 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-12008a57-6e35-4c4e-b16a-d16e2d1e8bc3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:38.904521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-12008a57-6e35-4c4e-b16a-d16e2d1e8bc3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:38.904948 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-12008a57-6e35-4c4e-b16a-d16e2d1e8bc3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:39.136094 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-12008a57-6e35-4c4e-b16a-d16e2d1e8bc3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:39.143881 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-12008a57-6e35-4c4e-b16a-d16e2d1e8bc3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5" status: 200 len: 1366 microversion: 2.1 time: 0.251406 May 12 11:55:39.152941 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 492/987] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:38 2022] GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:39.265652 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-87572fc1-ced1-44b0-b46c-8a0b09912d9a req-92b10636-bb4f-46b6-9a1a-88ad2d770a6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "394f6d14-8132-47a7-bef1-a85dedfe3ae5", "tag": "06a8e516-6fdc-460e-998f-975002bacca1"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:55:39.276032 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-87572fc1-ced1-44b0-b46c-8a0b09912d9a req-92b10636-bb4f-46b6-9a1a-88ad2d770a6a service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:39.276640 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-87572fc1-ced1-44b0-b46c-8a0b09912d9a req-92b10636-bb4f-46b6-9a1a-88ad2d770a6a service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:39.291789 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-87572fc1-ced1-44b0-b46c-8a0b09912d9a req-92b10636-bb4f-46b6-9a1a-88ad2d770a6a service nova] Creating event network-changed:06a8e516-6fdc-460e-998f-975002bacca1 for instance 394f6d14-8132-47a7-bef1-a85dedfe3ae5 on hv-cinder-80473 May 12 11:55:39.298205 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-87572fc1-ced1-44b0-b46c-8a0b09912d9a req-92b10636-bb4f-46b6-9a1a-88ad2d770a6a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036629 May 12 11:55:39.299142 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 496/988] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:55:40.160452 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-80303467-1c3a-4f20-9801-687cb10cedd2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:40.161059 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-80303467-1c3a-4f20-9801-687cb10cedd2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:40.167513 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-80303467-1c3a-4f20-9801-687cb10cedd2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:40.167940 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-80303467-1c3a-4f20-9801-687cb10cedd2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:40.168701 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-80303467-1c3a-4f20-9801-687cb10cedd2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:40.169135 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-80303467-1c3a-4f20-9801-687cb10cedd2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:40.301138 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-80303467-1c3a-4f20-9801-687cb10cedd2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:40.308413 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-80303467-1c3a-4f20-9801-687cb10cedd2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5" status: 200 len: 1366 microversion: 2.1 time: 0.151852 May 12 11:55:40.308992 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 493/989] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:40 2022] GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:41.324955 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-18c0e895-9de9-4f8c-aad1-4ae43d8e64a5 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:41.325573 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-18c0e895-9de9-4f8c-aad1-4ae43d8e64a5 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:41.336406 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-18c0e895-9de9-4f8c-aad1-4ae43d8e64a5 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:41.336869 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-18c0e895-9de9-4f8c-aad1-4ae43d8e64a5 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:41.337652 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-18c0e895-9de9-4f8c-aad1-4ae43d8e64a5 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:41.338130 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-18c0e895-9de9-4f8c-aad1-4ae43d8e64a5 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:41.467192 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-18c0e895-9de9-4f8c-aad1-4ae43d8e64a5 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:41.474703 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-18c0e895-9de9-4f8c-aad1-4ae43d8e64a5 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5" status: 200 len: 1366 microversion: 2.1 time: 0.154036 May 12 11:55:41.475280 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 497/990] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:41 2022] GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:42.491371 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-90036e0a-d7ee-4924-a6d1-d789963193f0 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:42.491932 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-90036e0a-d7ee-4924-a6d1-d789963193f0 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:42.498288 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-90036e0a-d7ee-4924-a6d1-d789963193f0 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:42.498740 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-90036e0a-d7ee-4924-a6d1-d789963193f0 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:42.499507 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-90036e0a-d7ee-4924-a6d1-d789963193f0 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:42.499945 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-90036e0a-d7ee-4924-a6d1-d789963193f0 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:42.623566 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-90036e0a-d7ee-4924-a6d1-d789963193f0 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:42.631154 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-90036e0a-d7ee-4924-a6d1-d789963193f0 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5" status: 200 len: 1366 microversion: 2.1 time: 0.143838 May 12 11:55:42.631712 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 494/991] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:42 2022] GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:43.648136 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-5f1047b6-0a34-4127-9ad7-1ccec39d509c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:43.648682 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-5f1047b6-0a34-4127-9ad7-1ccec39d509c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:43.655036 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5f1047b6-0a34-4127-9ad7-1ccec39d509c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:43.655497 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5f1047b6-0a34-4127-9ad7-1ccec39d509c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:43.656270 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5f1047b6-0a34-4127-9ad7-1ccec39d509c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:43.656712 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5f1047b6-0a34-4127-9ad7-1ccec39d509c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:43.788479 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-5f1047b6-0a34-4127-9ad7-1ccec39d509c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:43.795629 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-5f1047b6-0a34-4127-9ad7-1ccec39d509c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5" status: 200 len: 1366 microversion: 2.1 time: 0.151385 May 12 11:55:43.796200 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 498/992] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:43 2022] GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:44.812417 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-fb9a0149-acef-43c3-abe5-56c5125a9052 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:44.812941 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-fb9a0149-acef-43c3-abe5-56c5125a9052 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:44.819907 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fb9a0149-acef-43c3-abe5-56c5125a9052 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:44.820349 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fb9a0149-acef-43c3-abe5-56c5125a9052 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:44.821139 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fb9a0149-acef-43c3-abe5-56c5125a9052 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:44.821568 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fb9a0149-acef-43c3-abe5-56c5125a9052 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:44.947970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-fb9a0149-acef-43c3-abe5-56c5125a9052 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:44.955125 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-fb9a0149-acef-43c3-abe5-56c5125a9052 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5" status: 200 len: 1366 microversion: 2.1 time: 0.146658 May 12 11:55:44.955692 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 495/993] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:44 2022] GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:45.461260 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-f74585d2-b248-4e7c-9cea-326c64083afc req-f7c28ba9-d730-491f-8c73-2cf49a6f1e66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394f6d14-8132-47a7-bef1-a85dedfe3ae5", "name": "network-vif-plugged", "status": "completed", "tag": "06a8e516-6fdc-460e-998f-975002bacca1"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:55:45.470584 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-f74585d2-b248-4e7c-9cea-326c64083afc req-f7c28ba9-d730-491f-8c73-2cf49a6f1e66 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:45.471040 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-f74585d2-b248-4e7c-9cea-326c64083afc req-f7c28ba9-d730-491f-8c73-2cf49a6f1e66 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:45.484601 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-f74585d2-b248-4e7c-9cea-326c64083afc req-f7c28ba9-d730-491f-8c73-2cf49a6f1e66 service nova] Creating event network-vif-plugged:06a8e516-6fdc-460e-998f-975002bacca1 for instance 394f6d14-8132-47a7-bef1-a85dedfe3ae5 on hv-cinder-80473 May 12 11:55:45.489678 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-f74585d2-b248-4e7c-9cea-326c64083afc req-f7c28ba9-d730-491f-8c73-2cf49a6f1e66 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093084 May 12 11:55:45.490371 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 499/994] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:55:45.972155 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-27c3666d-e98a-4b9e-bd34-f6a71ee2ec8a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:45.972679 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-27c3666d-e98a-4b9e-bd34-f6a71ee2ec8a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:45.979114 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-27c3666d-e98a-4b9e-bd34-f6a71ee2ec8a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:45.979559 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-27c3666d-e98a-4b9e-bd34-f6a71ee2ec8a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:45.980331 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-27c3666d-e98a-4b9e-bd34-f6a71ee2ec8a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:45.980771 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-27c3666d-e98a-4b9e-bd34-f6a71ee2ec8a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:46.109130 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-27c3666d-e98a-4b9e-bd34-f6a71ee2ec8a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:46.116907 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-27c3666d-e98a-4b9e-bd34-f6a71ee2ec8a tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5" status: 200 len: 1366 microversion: 2.1 time: 0.148978 May 12 11:55:46.117475 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 496/995] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:45 2022] GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:47.135249 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-a769fad9-be19-4cf7-8627-292bb67e699b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:47.135956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-a769fad9-be19-4cf7-8627-292bb67e699b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:47.142736 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a769fad9-be19-4cf7-8627-292bb67e699b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:47.143193 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a769fad9-be19-4cf7-8627-292bb67e699b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:47.143980 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a769fad9-be19-4cf7-8627-292bb67e699b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:47.144511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-a769fad9-be19-4cf7-8627-292bb67e699b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:47.278480 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-a769fad9-be19-4cf7-8627-292bb67e699b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:47.286551 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-a769fad9-be19-4cf7-8627-292bb67e699b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5" status: 200 len: 1366 microversion: 2.1 time: 0.155949 May 12 11:55:47.287130 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 500/996] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:47 2022] GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:48.303445 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-448804e0-a355-4bb1-adee-e04225b2d6f2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:48.304088 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-448804e0-a355-4bb1-adee-e04225b2d6f2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:48.310684 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-448804e0-a355-4bb1-adee-e04225b2d6f2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:48.311133 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-448804e0-a355-4bb1-adee-e04225b2d6f2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:48.311900 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-448804e0-a355-4bb1-adee-e04225b2d6f2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:48.312337 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-448804e0-a355-4bb1-adee-e04225b2d6f2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:48.441332 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-448804e0-a355-4bb1-adee-e04225b2d6f2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:55:48.448635 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-448804e0-a355-4bb1-adee-e04225b2d6f2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5" status: 200 len: 1557 microversion: 2.1 time: 0.149111 May 12 11:55:48.449426 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 497/997] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:55:48 2022] GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:55:48.464956 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-fa2706ce-26f3-410d-8619-be48db0f17e2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:55:48.465439 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-fa2706ce-26f3-410d-8619-be48db0f17e2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:55:48.472550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fa2706ce-26f3-410d-8619-be48db0f17e2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:48.473003 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fa2706ce-26f3-410d-8619-be48db0f17e2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:48.473794 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fa2706ce-26f3-410d-8619-be48db0f17e2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:48.474238 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fa2706ce-26f3-410d-8619-be48db0f17e2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:48.548620 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-fa2706ce-26f3-410d-8619-be48db0f17e2 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087424 May 12 11:55:48.549211 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 501/998] 10.222.0.58 () {58 vars in 1274 bytes} [Thu May 12 11:55:48 2022] GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:55:49.562579 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-bff49638-bf5e-4771-a116-33dc72c20b82 req-ab2f91c0-f8e7-413b-8dfe-b1674260aa22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "394f6d14-8132-47a7-bef1-a85dedfe3ae5", "tag": "06a8e516-6fdc-460e-998f-975002bacca1"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:55:49.570491 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-bff49638-bf5e-4771-a116-33dc72c20b82 req-ab2f91c0-f8e7-413b-8dfe-b1674260aa22 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:55:49.570935 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-bff49638-bf5e-4771-a116-33dc72c20b82 req-ab2f91c0-f8e7-413b-8dfe-b1674260aa22 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:55:49.581513 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-bff49638-bf5e-4771-a116-33dc72c20b82 req-ab2f91c0-f8e7-413b-8dfe-b1674260aa22 service nova] Creating event network-changed:06a8e516-6fdc-460e-998f-975002bacca1 for instance 394f6d14-8132-47a7-bef1-a85dedfe3ae5 on hv-cinder-80473 May 12 11:55:49.586787 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-bff49638-bf5e-4771-a116-33dc72c20b82 req-ab2f91c0-f8e7-413b-8dfe-b1674260aa22 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081874 May 12 11:55:49.587441 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 498/999] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:56:25.299510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-fd477c12-8c77-421b-820e-402ea291208b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:56:25.300079 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-fd477c12-8c77-421b-820e-402ea291208b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:56:25.305973 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fd477c12-8c77-421b-820e-402ea291208b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:25.306428 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fd477c12-8c77-421b-820e-402ea291208b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:25.307190 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fd477c12-8c77-421b-820e-402ea291208b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:25.307635 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-fd477c12-8c77-421b-820e-402ea291208b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:25.331069 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-fd477c12-8c77-421b-820e-402ea291208b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5/ips" status: 200 len: 151 microversion: 2.1 time: 0.036064 May 12 11:56:25.331559 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 502/1000] 10.222.0.58 () {58 vars in 1247 bytes} [Thu May 12 11:56:25 2022] GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:56:26.635591 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-fbbe7b6d-9e71-4e60-829b-0a2a470d7754 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0507183d-0de9-40be-9d40-e8c6906d4eea"}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:56:26.636768 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-fbbe7b6d-9e71-4e60-829b-0a2a470d7754 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:56:26.642952 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fbbe7b6d-9e71-4e60-829b-0a2a470d7754 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:26.643404 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fbbe7b6d-9e71-4e60-829b-0a2a470d7754 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:26.644171 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fbbe7b6d-9e71-4e60-829b-0a2a470d7754 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:26.644609 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fbbe7b6d-9e71-4e60-829b-0a2a470d7754 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:26.885112 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-fbbe7b6d-9e71-4e60-829b-0a2a470d7754 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "POST /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254193 May 12 11:56:26.885758 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 499/1001] 10.222.0.58 () {60 vars in 1322 bytes} [Thu May 12 11:56:26 2022] POST /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:56:34.444528 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-88d22b1b-f0b2-4c3f-a03b-7840a9de1a9c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:56:34.445063 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-88d22b1b-f0b2-4c3f-a03b-7840a9de1a9c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:56:34.455970 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-88d22b1b-f0b2-4c3f-a03b-7840a9de1a9c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:34.456977 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-88d22b1b-f0b2-4c3f-a03b-7840a9de1a9c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:34.460845 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-88d22b1b-f0b2-4c3f-a03b-7840a9de1a9c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:34.460845 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-88d22b1b-f0b2-4c3f-a03b-7840a9de1a9c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:34.540620 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.objects.instance [None req-88d22b1b-f0b2-4c3f-a03b-7840a9de1a9c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lazy-loading 'services' on Instance uuid 394f6d14-8132-47a7-bef1-a85dedfe3ae5 {{(pid=123508) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 11:56:34.612901 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-88d22b1b-f0b2-4c3f-a03b-7840a9de1a9c tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "DELETE /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5/os-volume_attachments/0507183d-0de9-40be-9d40-e8c6906d4eea" status: 202 len: 0 microversion: 2.1 time: 0.173015 May 12 11:56:34.613501 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 503/1002] 10.222.0.58 () {58 vars in 1415 bytes} [Thu May 12 11:56:34 2022] DELETE /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5/os-volume_attachments/0507183d-0de9-40be-9d40-e8c6906d4eea => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:56:34.623006 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-d55c46bd-ca74-495a-ad91-285f5dfc14fb tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:56:34.624059 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d55c46bd-ca74-495a-ad91-285f5dfc14fb tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:56:34.631234 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d55c46bd-ca74-495a-ad91-285f5dfc14fb tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:34.631689 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d55c46bd-ca74-495a-ad91-285f5dfc14fb tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:34.632468 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d55c46bd-ca74-495a-ad91-285f5dfc14fb tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:34.632905 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d55c46bd-ca74-495a-ad91-285f5dfc14fb tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:34.662179 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-d55c46bd-ca74-495a-ad91-285f5dfc14fb tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043843 May 12 11:56:34.662738 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 500/1003] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 12 11:56:34 2022] GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:56:35.675496 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-5290706b-7684-4421-8818-a6a712ef78bf tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:56:35.676469 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-5290706b-7684-4421-8818-a6a712ef78bf tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:56:35.682701 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5290706b-7684-4421-8818-a6a712ef78bf tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:35.683153 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5290706b-7684-4421-8818-a6a712ef78bf tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:35.683921 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5290706b-7684-4421-8818-a6a712ef78bf tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:35.684355 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5290706b-7684-4421-8818-a6a712ef78bf tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:35.712368 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-5290706b-7684-4421-8818-a6a712ef78bf tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042311 May 12 11:56:35.712909 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 504/1004] 10.222.0.58 () {58 vars in 1301 bytes} [Thu May 12 11:56:35 2022] GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 11:56:35.768198 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-9eebe18f-fcfd-4256-bf7d-3f2ad24fc474 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:56:35.768685 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-9eebe18f-fcfd-4256-bf7d-3f2ad24fc474 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:56:35.775039 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9eebe18f-fcfd-4256-bf7d-3f2ad24fc474 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:35.775482 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9eebe18f-fcfd-4256-bf7d-3f2ad24fc474 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:35.776235 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9eebe18f-fcfd-4256-bf7d-3f2ad24fc474 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:35.776665 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9eebe18f-fcfd-4256-bf7d-3f2ad24fc474 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:35.800838 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-9eebe18f-fcfd-4256-bf7d-3f2ad24fc474 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Going to try to terminate instance {{(pid=123507) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 11:56:35.871112 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-9eebe18f-fcfd-4256-bf7d-3f2ad24fc474 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "DELETE /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5" status: 204 len: 0 microversion: 2.1 time: 0.106434 May 12 11:56:35.872076 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 501/1005] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:56:35 2022] DELETE /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 11:56:35.882258 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-9958d927-ff42-4c06-a02b-6e1f87c87bee tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:56:35.882891 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-9958d927-ff42-4c06-a02b-6e1f87c87bee tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:56:35.888683 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9958d927-ff42-4c06-a02b-6e1f87c87bee tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:35.889140 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9958d927-ff42-4c06-a02b-6e1f87c87bee tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:35.889948 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9958d927-ff42-4c06-a02b-6e1f87c87bee tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:35.890390 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9958d927-ff42-4c06-a02b-6e1f87c87bee tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:36.015499 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-9958d927-ff42-4c06-a02b-6e1f87c87bee tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:56:36.022798 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-9958d927-ff42-4c06-a02b-6e1f87c87bee tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5" status: 200 len: 1682 microversion: 2.1 time: 0.145658 May 12 11:56:36.023370 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 505/1006] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:56:35 2022] GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5 => generated 1682 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:56:37.041088 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-7c759952-cb5d-4185-9f43-af8940eb7c78 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:56:37.042341 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-7c759952-cb5d-4185-9f43-af8940eb7c78 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:56:37.049249 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7c759952-cb5d-4185-9f43-af8940eb7c78 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:37.049775 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7c759952-cb5d-4185-9f43-af8940eb7c78 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:37.050571 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7c759952-cb5d-4185-9f43-af8940eb7c78 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:37.051043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7c759952-cb5d-4185-9f43-af8940eb7c78 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:37.175013 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-7c759952-cb5d-4185-9f43-af8940eb7c78 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:56:37.182299 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-7c759952-cb5d-4185-9f43-af8940eb7c78 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5" status: 200 len: 1682 microversion: 2.1 time: 0.145610 May 12 11:56:37.182866 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 502/1007] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:56:37 2022] GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5 => generated 1682 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:56:38.198298 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-252abd0c-de09-4af7-b1ca-441072c13628 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:56:38.198941 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-252abd0c-de09-4af7-b1ca-441072c13628 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:56:38.205359 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-252abd0c-de09-4af7-b1ca-441072c13628 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:38.205844 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-252abd0c-de09-4af7-b1ca-441072c13628 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:38.207287 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-252abd0c-de09-4af7-b1ca-441072c13628 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:38.207724 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-252abd0c-de09-4af7-b1ca-441072c13628 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:38.342464 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-252abd0c-de09-4af7-b1ca-441072c13628 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61fcd9d503734952b0ea9ec6ef96be6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b284fcbfe0214240a616a6d68cedfed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:56:38.351510 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-252abd0c-de09-4af7-b1ca-441072c13628 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5" status: 200 len: 1682 microversion: 2.1 time: 0.157023 May 12 11:56:38.352098 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 506/1008] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:56:38 2022] GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:56:38.697643 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-da0ecc40-c1d6-4705-b955-286637d2e24f req-6142b55d-4433-45c8-95b5-327f68b64cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394f6d14-8132-47a7-bef1-a85dedfe3ae5", "name": "network-vif-deleted", "tag": "06a8e516-6fdc-460e-998f-975002bacca1"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:56:38.706478 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-da0ecc40-c1d6-4705-b955-286637d2e24f req-6142b55d-4433-45c8-95b5-327f68b64cd5 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:38.706934 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-da0ecc40-c1d6-4705-b955-286637d2e24f req-6142b55d-4433-45c8-95b5-327f68b64cd5 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:38.720970 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-da0ecc40-c1d6-4705-b955-286637d2e24f req-6142b55d-4433-45c8-95b5-327f68b64cd5 service nova] Creating event network-vif-deleted:06a8e516-6fdc-460e-998f-975002bacca1 for instance 394f6d14-8132-47a7-bef1-a85dedfe3ae5 on hv-cinder-80473 May 12 11:56:38.725886 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-da0ecc40-c1d6-4705-b955-286637d2e24f req-6142b55d-4433-45c8-95b5-327f68b64cd5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093464 May 12 11:56:38.726914 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 503/1009] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:56:39.368356 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-7d801079-0d0d-475e-8491-c8f2e8f8138e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:56:39.368974 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-7d801079-0d0d-475e-8491-c8f2e8f8138e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:56:39.375752 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7d801079-0d0d-475e-8491-c8f2e8f8138e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:39.376211 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7d801079-0d0d-475e-8491-c8f2e8f8138e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:39.377007 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7d801079-0d0d-475e-8491-c8f2e8f8138e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:39.377456 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7d801079-0d0d-475e-8491-c8f2e8f8138e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:39.391415 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-7d801079-0d0d-475e-8491-c8f2e8f8138e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] HTTP exception thrown: Instance 394f6d14-8132-47a7-bef1-a85dedfe3ae5 could not be found. May 12 11:56:39.393081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-7d801079-0d0d-475e-8491-c8f2e8f8138e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Request method failure captured: May 12 11:56:39.393081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5 HTTP/1.1 May 12 11:56:39.393081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:56:39.393081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:56:39.393081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:56:39.393081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:56:39.393081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:56:39.393081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:56:39.393081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:56:39.393081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:56:39.393081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPT8DEqCl4bX1_JU4Gitc3XogKR68P5YOrihZb3A5s6OOjrNceKy4j0AAlhI1OykUdJ79F3DICwWoBGKYb9sTlx-KD1LIJeTeUwhzJM4K7lZwKUqOtx8Qx0TugCbusjZJDLOtH8-zZzIn16n9DfmdO2XxMASJeCEJXf-EhUNFNzhC9Q May 12 11:56:39.393081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:56:39.393081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:56:39.393081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:56:39.393081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:56:39.393081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:56:39.393081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:56:39.393081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:56:39.393081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:39.393081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:56:39.393081 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:56:39.395277 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b284fcbfe0214240a616a6d68cedfed2", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:56:39.395277 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:39.395277 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:56:39.395277 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:39.395277 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:56:39.395277 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:56:39.395277 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:56:39.395277 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 61fcd9d503734952b0ea9ec6ef96be6c May 12 11:56:39.395277 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:56:39.395277 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:56:39.395277 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance 394f6d14-8132-47a7-bef1-a85dedfe3ae5 could not be found. May 12 11:56:39.395277 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': '394f6d14-8132-47a7-bef1-a85dedfe3ae5'} May 12 11:56:39.396511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:56:39.396511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:39.396511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:56:39.396511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:56:39.396511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:56:39.396511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:56:39.396511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:56:39.396511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:56:39.396511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:56:39.396511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:56:39.396511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 394f6d14-8132-47a7-bef1-a85dedfe3ae5 could not be found. May 12 11:56:39.396511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:39.396511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:56:39.396511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:39.396511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:39.396511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:56:39.396511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:56:39.396511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:56:39.396511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:56:39.396511 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:56:39.397858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:56:39.397858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:56:39.397858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:56:39.397858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:56:39.397858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:56:39.397858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:56:39.397858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:56:39.397858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 394f6d14-8132-47a7-bef1-a85dedfe3ae5 could not be found. May 12 11:56:39.397858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:39.397858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:56:39.397858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:39.397858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:39.397858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:56:39.397858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:56:39.397858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:56:39.397858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:56:39.397858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 394f6d14-8132-47a7-bef1-a85dedfe3ae5 could not be found. May 12 11:56:39.397858 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:39.399004 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-7d801079-0d0d-475e-8491-c8f2e8f8138e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Returning 404 to user: Instance 394f6d14-8132-47a7-bef1-a85dedfe3ae5 could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:56:39.399004 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-7d801079-0d0d-475e-8491-c8f2e8f8138e tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5" status: 404 len: 111 microversion: 2.1 time: 0.030604 May 12 11:56:39.399004 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 507/1010] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:56:39 2022] GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:56:39.404491 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-0e571f53-f97c-4b48-bc1e-cc4359b4af2b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '.version_select at 0x7f29f1cd0e50>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:56:39.422731 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-0e571f53-f97c-4b48-bc1e-cc4359b4af2b tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1776740030" status: 202 len: 0 microversion: 2.1 time: 0.022302 May 12 11:56:39.426594 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 504/1011] 10.222.0.58 () {58 vars in 1220 bytes} [Thu May 12 11:56:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1776740030 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 11:56:41.179120 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-55b9ad0e-dbe4-44eb-bec3-221ee4527bbe tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:56:41.179642 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-55b9ad0e-dbe4-44eb-bec3-221ee4527bbe tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:56:41.186062 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-55b9ad0e-dbe4-44eb-bec3-221ee4527bbe tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:41.186516 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-55b9ad0e-dbe4-44eb-bec3-221ee4527bbe tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:41.187288 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-55b9ad0e-dbe4-44eb-bec3-221ee4527bbe tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:41.187730 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-55b9ad0e-dbe4-44eb-bec3-221ee4527bbe tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:41.201422 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-55b9ad0e-dbe4-44eb-bec3-221ee4527bbe tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] HTTP exception thrown: Instance 394f6d14-8132-47a7-bef1-a85dedfe3ae5 could not be found. May 12 11:56:41.202986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-55b9ad0e-dbe4-44eb-bec3-221ee4527bbe tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Request method failure captured: May 12 11:56:41.202986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: DELETE /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5 HTTP/1.1 May 12 11:56:41.202986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:56:41.202986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:56:41.202986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:56:41.202986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:56:41.202986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:56:41.202986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:56:41.202986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:56:41.202986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:56:41.202986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPT8DEqCl4bX1_JU4Gitc3XogKR68P5YOrihZb3A5s6OOjrNceKy4j0AAlhI1OykUdJ79F3DICwWoBGKYb9sTlx-KD1LIJeTeUwhzJM4K7lZwKUqOtx8Qx0TugCbusjZJDLOtH8-zZzIn16n9DfmdO2XxMASJeCEJXf-EhUNFNzhC9Q May 12 11:56:41.202986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:56:41.202986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:56:41.202986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:56:41.202986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:56:41.202986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:56:41.202986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:56:41.202986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:56:41.202986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:41.202986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:56:41.202986 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:56:41.204588 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b284fcbfe0214240a616a6d68cedfed2", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:56:41.204588 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:41.204588 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:56:41.204588 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:41.204588 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:56:41.204588 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:56:41.204588 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:56:41.204588 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 61fcd9d503734952b0ea9ec6ef96be6c May 12 11:56:41.204588 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:56:41.204588 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:56:41.204588 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance 394f6d14-8132-47a7-bef1-a85dedfe3ae5 could not be found. May 12 11:56:41.204588 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': '394f6d14-8132-47a7-bef1-a85dedfe3ae5'} May 12 11:56:41.205399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:56:41.205399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:41.205399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:56:41.205399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:56:41.205399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:56:41.205399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:56:41.205399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:56:41.205399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:56:41.205399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:56:41.205399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:56:41.205399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 394f6d14-8132-47a7-bef1-a85dedfe3ae5 could not be found. May 12 11:56:41.205399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:41.205399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:56:41.205399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:41.205399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:41.205399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:56:41.205399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:56:41.205399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:56:41.205399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:56:41.205399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:56:41.207537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:56:41.207537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 11:56:41.207537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 11:56:41.207537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 11:56:41.207537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 11:56:41.207537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:56:41.207537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:56:41.207537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:56:41.207537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:56:41.207537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 394f6d14-8132-47a7-bef1-a85dedfe3ae5 could not be found. May 12 11:56:41.207537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:41.207537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:56:41.207537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:41.207537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:41.207537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:56:41.207537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:56:41.207537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:56:41.207537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:56:41.207537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 394f6d14-8132-47a7-bef1-a85dedfe3ae5 could not be found. May 12 11:56:41.207537 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:41.209014 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-55b9ad0e-dbe4-44eb-bec3-221ee4527bbe tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Returning 404 to user: Instance 394f6d14-8132-47a7-bef1-a85dedfe3ae5 could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:56:41.209014 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-55b9ad0e-dbe4-44eb-bec3-221ee4527bbe tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "DELETE /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5" status: 404 len: 111 microversion: 2.1 time: 0.029132 May 12 11:56:41.209014 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 508/1012] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:56:41 2022] DELETE /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:56:41.213223 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-ccf34734-98d8-4eb2-aa7b-5cba297fac05 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:56:41.213995 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-ccf34734-98d8-4eb2-aa7b-5cba297fac05 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 394f6d14-8132-47a7-bef1-a85dedfe3ae5] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:56:41.220521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ccf34734-98d8-4eb2-aa7b-5cba297fac05 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:41.221234 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ccf34734-98d8-4eb2-aa7b-5cba297fac05 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:41.222060 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ccf34734-98d8-4eb2-aa7b-5cba297fac05 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:41.222500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ccf34734-98d8-4eb2-aa7b-5cba297fac05 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:41.235475 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-ccf34734-98d8-4eb2-aa7b-5cba297fac05 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] HTTP exception thrown: Instance 394f6d14-8132-47a7-bef1-a85dedfe3ae5 could not be found. May 12 11:56:41.237080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-ccf34734-98d8-4eb2-aa7b-5cba297fac05 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Request method failure captured: May 12 11:56:41.237080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5 HTTP/1.1 May 12 11:56:41.237080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:56:41.237080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:56:41.237080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:56:41.237080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 0 May 12 11:56:41.237080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:56:41.237080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:56:41.237080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:56:41.237080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:56:41.237080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPT8DEqCl4bX1_JU4Gitc3XogKR68P5YOrihZb3A5s6OOjrNceKy4j0AAlhI1OykUdJ79F3DICwWoBGKYb9sTlx-KD1LIJeTeUwhzJM4K7lZwKUqOtx8Qx0TugCbusjZJDLOtH8-zZzIn16n9DfmdO2XxMASJeCEJXf-EhUNFNzhC9Q May 12 11:56:41.237080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:56:41.237080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:56:41.237080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:56:41.237080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:56:41.237080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:56:41.237080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:56:41.237080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:56:41.237080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:41.237080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:56:41.237080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:56:41.238653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b284fcbfe0214240a616a6d68cedfed2", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:56:41.238653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:41.238653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:56:41.238653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:41.238653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:56:41.238653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:56:41.238653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:56:41.238653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: 61fcd9d503734952b0ea9ec6ef96be6c May 12 11:56:41.238653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:56:41.238653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: > May 12 11:56:41.238653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Instance 394f6d14-8132-47a7-bef1-a85dedfe3ae5 could not be found. May 12 11:56:41.238653 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'id': '394f6d14-8132-47a7-bef1-a85dedfe3ae5'} May 12 11:56:41.239563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:56:41.239563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:41.239563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:56:41.239563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:56:41.239563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:56:41.239563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:56:41.239563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:56:41.239563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:56:41.239563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:56:41.239563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:56:41.239563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 394f6d14-8132-47a7-bef1-a85dedfe3ae5 could not be found. May 12 11:56:41.239563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:56:41.239563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:56:41.239563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:56:41.239563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:41.239563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:56:41.239563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:56:41.239563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:56:41.239563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:56:41.239563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:56:41.241043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:56:41.241043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:56:41.241043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:56:41.241043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:56:41.241043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:56:41.241043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:56:41.241043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:56:41.241043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 394f6d14-8132-47a7-bef1-a85dedfe3ae5 could not be found. May 12 11:56:41.241043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:56:41.241043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:56:41.241043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:56:41.241043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:41.241043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:56:41.241043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:56:41.241043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:56:41.241043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:56:41.241043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 394f6d14-8132-47a7-bef1-a85dedfe3ae5 could not be found. May 12 11:56:41.241043 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:56:41.242741 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-ccf34734-98d8-4eb2-aa7b-5cba297fac05 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Returning 404 to user: Instance 394f6d14-8132-47a7-bef1-a85dedfe3ae5 could not be found. {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:56:41.242741 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-ccf34734-98d8-4eb2-aa7b-5cba297fac05 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5" status: 404 len: 111 microversion: 2.1 time: 0.029164 May 12 11:56:41.242741 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 505/1013] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:56:41 2022] GET /compute/v2.1/servers/394f6d14-8132-47a7-bef1-a85dedfe3ae5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:56:42.369545 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b8eb8741-493d-42db-9126-95234445a2b3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:56:42.370072 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-b8eb8741-493d-42db-9126-95234445a2b3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:56:42.376324 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b8eb8741-493d-42db-9126-95234445a2b3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:42.376767 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b8eb8741-493d-42db-9126-95234445a2b3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:42.377530 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b8eb8741-493d-42db-9126-95234445a2b3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:42.377999 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-b8eb8741-493d-42db-9126-95234445a2b3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:42.390963 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-b8eb8741-493d-42db-9126-95234445a2b3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] HTTP exception thrown: Instance 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d could not be found. May 12 11:56:42.392466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b8eb8741-493d-42db-9126-95234445a2b3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Request method failure captured: May 12 11:56:42.392466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: DELETE /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d HTTP/1.1 May 12 11:56:42.392466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:56:42.392466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:56:42.392466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:56:42.392466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:56:42.392466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:56:42.392466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:56:42.392466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:56:42.392466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:56:42.392466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPT8DEqCl4bX1_JU4Gitc3XogKR68P5YOrihZb3A5s6OOjrNceKy4j0AAlhI1OykUdJ79F3DICwWoBGKYb9sTlx-KD1LIJeTeUwhzJM4K7lZwKUqOtx8Qx0TugCbusjZJDLOtH8-zZzIn16n9DfmdO2XxMASJeCEJXf-EhUNFNzhC9Q May 12 11:56:42.392466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:56:42.392466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:56:42.392466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:56:42.392466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:56:42.392466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:56:42.392466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:56:42.392466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:56:42.392466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:42.392466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:56:42.392466 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:56:42.394687 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b284fcbfe0214240a616a6d68cedfed2", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:56:42.394687 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:42.394687 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:56:42.394687 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:42.394687 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:56:42.394687 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:56:42.394687 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:56:42.394687 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 61fcd9d503734952b0ea9ec6ef96be6c May 12 11:56:42.394687 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:56:42.394687 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:56:42.394687 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d could not be found. May 12 11:56:42.394687 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': '7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d'} May 12 11:56:42.395716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:56:42.395716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:42.395716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:56:42.395716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:56:42.395716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:56:42.395716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:56:42.395716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:56:42.395716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:56:42.395716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:56:42.395716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:56:42.395716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d could not be found. May 12 11:56:42.395716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:42.395716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:56:42.395716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:42.395716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:42.395716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:56:42.395716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:56:42.395716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:56:42.395716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:56:42.395716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:56:42.397167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:56:42.397167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 11:56:42.397167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 11:56:42.397167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 11:56:42.397167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 11:56:42.397167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:56:42.397167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:56:42.397167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:56:42.397167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:56:42.397167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d could not be found. May 12 11:56:42.397167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:42.397167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:56:42.397167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:42.397167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:42.397167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:56:42.397167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:56:42.397167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:56:42.397167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:56:42.397167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d could not be found. May 12 11:56:42.397167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:42.398727 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-b8eb8741-493d-42db-9126-95234445a2b3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Returning 404 to user: Instance 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:56:42.398727 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-b8eb8741-493d-42db-9126-95234445a2b3 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d" status: 404 len: 111 microversion: 2.1 time: 0.028127 May 12 11:56:42.398727 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 509/1014] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:56:42 2022] DELETE /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:56:42.402458 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-fca54000-fb26-4f4f-8588-584a14c103c7 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:56:42.403078 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-fca54000-fb26-4f4f-8588-584a14c103c7 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:56:42.409037 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fca54000-fb26-4f4f-8588-584a14c103c7 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:42.410164 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fca54000-fb26-4f4f-8588-584a14c103c7 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:42.410948 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fca54000-fb26-4f4f-8588-584a14c103c7 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:42.411392 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fca54000-fb26-4f4f-8588-584a14c103c7 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:42.426525 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-fca54000-fb26-4f4f-8588-584a14c103c7 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] HTTP exception thrown: Instance 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d could not be found. May 12 11:56:42.428031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-fca54000-fb26-4f4f-8588-584a14c103c7 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Request method failure captured: May 12 11:56:42.428031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d HTTP/1.1 May 12 11:56:42.428031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:56:42.428031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:56:42.428031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:56:42.428031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 0 May 12 11:56:42.428031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:56:42.428031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:56:42.428031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:56:42.428031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:56:42.428031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPT8DEqCl4bX1_JU4Gitc3XogKR68P5YOrihZb3A5s6OOjrNceKy4j0AAlhI1OykUdJ79F3DICwWoBGKYb9sTlx-KD1LIJeTeUwhzJM4K7lZwKUqOtx8Qx0TugCbusjZJDLOtH8-zZzIn16n9DfmdO2XxMASJeCEJXf-EhUNFNzhC9Q May 12 11:56:42.428031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:56:42.428031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:56:42.428031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:56:42.428031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:56:42.428031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:56:42.428031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:56:42.428031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:56:42.428031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:42.428031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:56:42.428031 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:56:42.429562 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b284fcbfe0214240a616a6d68cedfed2", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:56:42.429562 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:42.429562 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:56:42.429562 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:42.429562 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:56:42.429562 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:56:42.429562 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:56:42.429562 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: 61fcd9d503734952b0ea9ec6ef96be6c May 12 11:56:42.429562 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:56:42.429562 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: > May 12 11:56:42.429562 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Instance 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d could not be found. May 12 11:56:42.429562 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'id': '7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d'} May 12 11:56:42.430633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:56:42.430633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:42.430633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:56:42.430633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:56:42.430633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:56:42.430633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:56:42.430633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:56:42.430633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:56:42.430633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:56:42.430633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:56:42.430633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d could not be found. May 12 11:56:42.430633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:56:42.430633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:56:42.430633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:56:42.430633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:42.430633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:56:42.430633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:56:42.430633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:56:42.430633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:56:42.430633 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:56:42.432074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:56:42.432074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:56:42.432074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:56:42.432074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:56:42.432074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:56:42.432074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:56:42.432074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:56:42.432074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d could not be found. May 12 11:56:42.432074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:56:42.432074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:56:42.432074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:56:42.432074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:42.432074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:56:42.432074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:56:42.432074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:56:42.432074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:56:42.432074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d could not be found. May 12 11:56:42.432074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:56:42.433478 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-fca54000-fb26-4f4f-8588-584a14c103c7 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Returning 404 to user: Instance 7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d could not be found. {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:56:42.433478 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-fca54000-fb26-4f4f-8588-584a14c103c7 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d" status: 404 len: 111 microversion: 2.1 time: 0.030652 May 12 11:56:42.433478 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 506/1015] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:56:42 2022] GET /compute/v2.1/servers/7928bfef-eec7-4a0e-bed8-b18f5f4e3b7d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 11:56:42.437459 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-56c05dd3-2bdc-4e96-a9a1-9a6b77a953c8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:56:42.437973 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-56c05dd3-2bdc-4e96-a9a1-9a6b77a953c8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 2a77980d-5760-4526-a9e7-dc3f71a4a0c0] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:56:42.443758 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-56c05dd3-2bdc-4e96-a9a1-9a6b77a953c8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:42.444205 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-56c05dd3-2bdc-4e96-a9a1-9a6b77a953c8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:42.444960 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-56c05dd3-2bdc-4e96-a9a1-9a6b77a953c8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:42.445396 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-56c05dd3-2bdc-4e96-a9a1-9a6b77a953c8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:42.459063 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-56c05dd3-2bdc-4e96-a9a1-9a6b77a953c8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] HTTP exception thrown: Instance 2a77980d-5760-4526-a9e7-dc3f71a4a0c0 could not be found. May 12 11:56:42.460590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-56c05dd3-2bdc-4e96-a9a1-9a6b77a953c8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Request method failure captured: May 12 11:56:42.460590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: DELETE /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0 HTTP/1.1 May 12 11:56:42.460590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:56:42.460590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:56:42.460590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:56:42.460590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:56:42.460590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:56:42.460590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:56:42.460590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:56:42.460590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:56:42.460590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPT8DEqCl4bX1_JU4Gitc3XogKR68P5YOrihZb3A5s6OOjrNceKy4j0AAlhI1OykUdJ79F3DICwWoBGKYb9sTlx-KD1LIJeTeUwhzJM4K7lZwKUqOtx8Qx0TugCbusjZJDLOtH8-zZzIn16n9DfmdO2XxMASJeCEJXf-EhUNFNzhC9Q May 12 11:56:42.460590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:56:42.460590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:56:42.460590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:56:42.460590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:56:42.460590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:56:42.460590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:56:42.460590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:56:42.460590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:42.460590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:56:42.460590 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:56:42.462194 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b284fcbfe0214240a616a6d68cedfed2", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:56:42.462194 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:42.462194 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:56:42.462194 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:42.462194 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:56:42.462194 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:56:42.462194 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:56:42.462194 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 61fcd9d503734952b0ea9ec6ef96be6c May 12 11:56:42.462194 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:56:42.462194 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:56:42.462194 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance 2a77980d-5760-4526-a9e7-dc3f71a4a0c0 could not be found. May 12 11:56:42.462194 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': '2a77980d-5760-4526-a9e7-dc3f71a4a0c0'} May 12 11:56:42.463088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:56:42.463088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:42.463088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:56:42.463088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:56:42.463088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:56:42.463088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:56:42.463088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:56:42.463088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:56:42.463088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:56:42.463088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:56:42.463088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a77980d-5760-4526-a9e7-dc3f71a4a0c0 could not be found. May 12 11:56:42.463088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:42.463088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:56:42.463088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:42.463088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:42.463088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:56:42.463088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:56:42.463088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:56:42.463088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:56:42.463088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:56:42.464579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:56:42.464579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 11:56:42.464579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 11:56:42.464579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 11:56:42.464579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 11:56:42.464579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:56:42.464579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:56:42.464579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:56:42.464579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:56:42.464579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a77980d-5760-4526-a9e7-dc3f71a4a0c0 could not be found. May 12 11:56:42.464579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:42.464579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:56:42.464579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:42.464579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:42.464579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:56:42.464579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:56:42.464579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:56:42.464579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:56:42.464579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a77980d-5760-4526-a9e7-dc3f71a4a0c0 could not be found. May 12 11:56:42.464579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:42.466142 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-56c05dd3-2bdc-4e96-a9a1-9a6b77a953c8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Returning 404 to user: Instance 2a77980d-5760-4526-a9e7-dc3f71a4a0c0 could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:56:42.466142 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-56c05dd3-2bdc-4e96-a9a1-9a6b77a953c8 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0" status: 404 len: 111 microversion: 2.1 time: 0.028227 May 12 11:56:42.466142 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 510/1016] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:56:42 2022] DELETE /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:56:42.471642 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-62ccadc9-e3a5-4d27-ae22-3b4d926b30fe tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:56:42.472855 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-62ccadc9-e3a5-4d27-ae22-3b4d926b30fe tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 2a77980d-5760-4526-a9e7-dc3f71a4a0c0] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:56:42.478783 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-62ccadc9-e3a5-4d27-ae22-3b4d926b30fe tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:42.479235 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-62ccadc9-e3a5-4d27-ae22-3b4d926b30fe tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:42.480001 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-62ccadc9-e3a5-4d27-ae22-3b4d926b30fe tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:42.480447 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-62ccadc9-e3a5-4d27-ae22-3b4d926b30fe tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:42.493493 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-62ccadc9-e3a5-4d27-ae22-3b4d926b30fe tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] HTTP exception thrown: Instance 2a77980d-5760-4526-a9e7-dc3f71a4a0c0 could not be found. May 12 11:56:42.495027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-62ccadc9-e3a5-4d27-ae22-3b4d926b30fe tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Request method failure captured: May 12 11:56:42.495027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0 HTTP/1.1 May 12 11:56:42.495027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:56:42.495027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:56:42.495027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:56:42.495027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 0 May 12 11:56:42.495027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:56:42.495027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:56:42.495027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:56:42.495027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:56:42.495027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPT8DEqCl4bX1_JU4Gitc3XogKR68P5YOrihZb3A5s6OOjrNceKy4j0AAlhI1OykUdJ79F3DICwWoBGKYb9sTlx-KD1LIJeTeUwhzJM4K7lZwKUqOtx8Qx0TugCbusjZJDLOtH8-zZzIn16n9DfmdO2XxMASJeCEJXf-EhUNFNzhC9Q May 12 11:56:42.495027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:56:42.495027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:56:42.495027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:56:42.495027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:56:42.495027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:56:42.495027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:56:42.495027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:56:42.495027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:42.495027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:56:42.495027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:56:42.496584 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b284fcbfe0214240a616a6d68cedfed2", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:56:42.496584 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:42.496584 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:56:42.496584 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:42.496584 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:56:42.496584 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:56:42.496584 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:56:42.496584 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: 61fcd9d503734952b0ea9ec6ef96be6c May 12 11:56:42.496584 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:56:42.496584 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: > May 12 11:56:42.496584 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Instance 2a77980d-5760-4526-a9e7-dc3f71a4a0c0 could not be found. May 12 11:56:42.496584 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'id': '2a77980d-5760-4526-a9e7-dc3f71a4a0c0'} May 12 11:56:42.497375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:56:42.497375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:42.497375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:56:42.497375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:56:42.497375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:56:42.497375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:56:42.497375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:56:42.497375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:56:42.497375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:56:42.497375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:56:42.497375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a77980d-5760-4526-a9e7-dc3f71a4a0c0 could not be found. May 12 11:56:42.497375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:56:42.497375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:56:42.497375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:56:42.497375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:42.497375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:56:42.497375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:56:42.497375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:56:42.497375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:56:42.497375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:56:42.498611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:56:42.498611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:56:42.498611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:56:42.498611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:56:42.498611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:56:42.498611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:56:42.498611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:56:42.498611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a77980d-5760-4526-a9e7-dc3f71a4a0c0 could not be found. May 12 11:56:42.498611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:56:42.498611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:56:42.498611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:56:42.498611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:42.498611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:56:42.498611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:56:42.498611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:56:42.498611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:56:42.498611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a77980d-5760-4526-a9e7-dc3f71a4a0c0 could not be found. May 12 11:56:42.498611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:56:42.499916 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-62ccadc9-e3a5-4d27-ae22-3b4d926b30fe tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Returning 404 to user: Instance 2a77980d-5760-4526-a9e7-dc3f71a4a0c0 could not be found. {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:56:42.499916 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-62ccadc9-e3a5-4d27-ae22-3b4d926b30fe tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0" status: 404 len: 111 microversion: 2.1 time: 0.028840 May 12 11:56:42.499916 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 507/1017] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:56:42 2022] GET /compute/v2.1/servers/2a77980d-5760-4526-a9e7-dc3f71a4a0c0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:56:43.625912 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-aa0b696f-8ce4-4da1-b8eb-ed21e827c8d1 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:56:43.626414 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-aa0b696f-8ce4-4da1-b8eb-ed21e827c8d1 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:56:43.633093 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-aa0b696f-8ce4-4da1-b8eb-ed21e827c8d1 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:43.633544 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-aa0b696f-8ce4-4da1-b8eb-ed21e827c8d1 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:43.634345 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-aa0b696f-8ce4-4da1-b8eb-ed21e827c8d1 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:43.634786 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-aa0b696f-8ce4-4da1-b8eb-ed21e827c8d1 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:43.648439 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-aa0b696f-8ce4-4da1-b8eb-ed21e827c8d1 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] HTTP exception thrown: Instance 401ebf5c-6096-418a-b3bd-8e987ed84f6a could not be found. May 12 11:56:43.650006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-aa0b696f-8ce4-4da1-b8eb-ed21e827c8d1 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Request method failure captured: May 12 11:56:43.650006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: DELETE /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a HTTP/1.1 May 12 11:56:43.650006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 11:56:43.650006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 11:56:43.650006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 11:56:43.650006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 11:56:43.650006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 11:56:43.650006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 11:56:43.650006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 11:56:43.650006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 11:56:43.650006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPT8DEqCl4bX1_JU4Gitc3XogKR68P5YOrihZb3A5s6OOjrNceKy4j0AAlhI1OykUdJ79F3DICwWoBGKYb9sTlx-KD1LIJeTeUwhzJM4K7lZwKUqOtx8Qx0TugCbusjZJDLOtH8-zZzIn16n9DfmdO2XxMASJeCEJXf-EhUNFNzhC9Q May 12 11:56:43.650006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 11:56:43.650006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 11:56:43.650006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 11:56:43.650006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 11:56:43.650006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 11:56:43.650006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 11:56:43.650006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:56:43.650006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:43.650006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 11:56:43.650006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 11:56:43.651589 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b284fcbfe0214240a616a6d68cedfed2", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:56:43.651589 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:43.651589 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:56:43.651589 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:43.651589 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:56:43.651589 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 11:56:43.651589 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 11:56:43.651589 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: 61fcd9d503734952b0ea9ec6ef96be6c May 12 11:56:43.651589 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:56:43.651589 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 11:56:43.651589 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance 401ebf5c-6096-418a-b3bd-8e987ed84f6a could not be found. May 12 11:56:43.651589 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': '401ebf5c-6096-418a-b3bd-8e987ed84f6a'} May 12 11:56:43.652495 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:56:43.652495 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:43.652495 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:56:43.652495 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:56:43.652495 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:56:43.652495 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:56:43.652495 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:56:43.652495 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:56:43.652495 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:56:43.652495 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:56:43.652495 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 401ebf5c-6096-418a-b3bd-8e987ed84f6a could not be found. May 12 11:56:43.652495 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:43.652495 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:56:43.652495 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:43.652495 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:43.652495 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:56:43.652495 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:56:43.652495 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:56:43.652495 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:56:43.652495 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:56:43.653735 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:56:43.653735 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 11:56:43.653735 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 11:56:43.653735 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 11:56:43.653735 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 11:56:43.653735 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:56:43.653735 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:56:43.653735 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:56:43.653735 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:56:43.653735 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 401ebf5c-6096-418a-b3bd-8e987ed84f6a could not be found. May 12 11:56:43.653735 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:43.653735 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:56:43.653735 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:43.653735 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:43.653735 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:56:43.653735 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:56:43.653735 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:56:43.653735 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:56:43.653735 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 401ebf5c-6096-418a-b3bd-8e987ed84f6a could not be found. May 12 11:56:43.653735 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 11:56:43.655006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-aa0b696f-8ce4-4da1-b8eb-ed21e827c8d1 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Returning 404 to user: Instance 401ebf5c-6096-418a-b3bd-8e987ed84f6a could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:56:43.655006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-aa0b696f-8ce4-4da1-b8eb-ed21e827c8d1 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "DELETE /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a" status: 404 len: 111 microversion: 2.1 time: 0.029316 May 12 11:56:43.655006 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 511/1018] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:56:43 2022] DELETE /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:56:43.659529 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-ca36a11e-8a4a-42f9-9f63-a556fbff8991 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:56:43.660142 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-ca36a11e-8a4a-42f9-9f63-a556fbff8991 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] [instance: 401ebf5c-6096-418a-b3bd-8e987ed84f6a] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:56:43.666405 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ca36a11e-8a4a-42f9-9f63-a556fbff8991 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:43.666851 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ca36a11e-8a4a-42f9-9f63-a556fbff8991 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:43.667611 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ca36a11e-8a4a-42f9-9f63-a556fbff8991 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:56:43.668046 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-ca36a11e-8a4a-42f9-9f63-a556fbff8991 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:56:43.681381 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-ca36a11e-8a4a-42f9-9f63-a556fbff8991 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] HTTP exception thrown: Instance 401ebf5c-6096-418a-b3bd-8e987ed84f6a could not be found. May 12 11:56:43.682908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-ca36a11e-8a4a-42f9-9f63-a556fbff8991 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Request method failure captured: May 12 11:56:43.682908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a HTTP/1.1 May 12 11:56:43.682908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:56:43.682908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:56:43.682908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:56:43.682908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 0 May 12 11:56:43.682908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:56:43.682908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:56:43.682908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:56:43.682908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:56:43.682908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPT8DEqCl4bX1_JU4Gitc3XogKR68P5YOrihZb3A5s6OOjrNceKy4j0AAlhI1OykUdJ79F3DICwWoBGKYb9sTlx-KD1LIJeTeUwhzJM4K7lZwKUqOtx8Qx0TugCbusjZJDLOtH8-zZzIn16n9DfmdO2XxMASJeCEJXf-EhUNFNzhC9Q May 12 11:56:43.682908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:56:43.682908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:56:43.682908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:56:43.682908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:56:43.682908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:56:43.682908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:56:43.682908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:56:43.682908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:43.682908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:56:43.682908 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:56:43.684578 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b284fcbfe0214240a616a6d68cedfed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b284fcbfe0214240a616a6d68cedfed2", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:56:43.684578 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:43.684578 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: b284fcbfe0214240a616a6d68cedfed2 May 12 11:56:43.684578 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020037902 May 12 11:56:43.684578 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:56:43.684578 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:56:43.684578 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:56:43.684578 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: 61fcd9d503734952b0ea9ec6ef96be6c May 12 11:56:43.684578 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-AttachVolumeNegativeTest-1020037902-project May 12 11:56:43.684578 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: > May 12 11:56:43.684578 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Instance 401ebf5c-6096-418a-b3bd-8e987ed84f6a could not be found. May 12 11:56:43.684578 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'id': '401ebf5c-6096-418a-b3bd-8e987ed84f6a'} May 12 11:56:43.685459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:56:43.685459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:43.685459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:56:43.685459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:56:43.685459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:56:43.685459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:56:43.685459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:56:43.685459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:56:43.685459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:56:43.685459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:56:43.685459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 401ebf5c-6096-418a-b3bd-8e987ed84f6a could not be found. May 12 11:56:43.685459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:56:43.685459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:56:43.685459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:56:43.685459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:43.685459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:56:43.685459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:56:43.685459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:56:43.685459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:56:43.685459 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:56:43.687008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:56:43.687008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:56:43.687008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:56:43.687008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:56:43.687008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:56:43.687008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:56:43.687008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:56:43.687008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 401ebf5c-6096-418a-b3bd-8e987ed84f6a could not be found. May 12 11:56:43.687008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:56:43.687008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:56:43.687008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:56:43.687008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:56:43.687008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:56:43.687008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:56:43.687008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:56:43.687008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:56:43.687008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 401ebf5c-6096-418a-b3bd-8e987ed84f6a could not be found. May 12 11:56:43.687008 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:56:43.688431 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-ca36a11e-8a4a-42f9-9f63-a556fbff8991 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] Returning 404 to user: Instance 401ebf5c-6096-418a-b3bd-8e987ed84f6a could not be found. {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:56:43.688431 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-ca36a11e-8a4a-42f9-9f63-a556fbff8991 tempest-AttachVolumeNegativeTest-1020037902 tempest-AttachVolumeNegativeTest-1020037902-project] 10.222.0.58 "GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a" status: 404 len: 111 microversion: 2.1 time: 0.028545 May 12 11:56:43.688431 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 508/1019] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:56:43 2022] GET /compute/v2.1/servers/401ebf5c-6096-418a-b3bd-8e987ed84f6a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:57:28.296969 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-2c7b5182-5395-428e-9c09-30edf49919a0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:57:28.297553 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-2c7b5182-5395-428e-9c09-30edf49919a0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:57:28.303364 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2c7b5182-5395-428e-9c09-30edf49919a0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:28.303818 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2c7b5182-5395-428e-9c09-30edf49919a0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:28.304579 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2c7b5182-5395-428e-9c09-30edf49919a0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:28.305013 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-2c7b5182-5395-428e-9c09-30edf49919a0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:28.329663 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-2c7b5182-5395-428e-9c09-30edf49919a0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] Going to try to terminate instance {{(pid=123508) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 11:57:28.407345 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-2c7b5182-5395-428e-9c09-30edf49919a0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "DELETE /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab" status: 204 len: 0 microversion: 2.1 time: 0.114034 May 12 11:57:28.408163 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 512/1020] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 11:57:28 2022] DELETE /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 11:57:28.416265 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-fe125514-613e-4938-a81c-8805b3569163 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:57:28.416881 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-fe125514-613e-4938-a81c-8805b3569163 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:57:28.422754 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fe125514-613e-4938-a81c-8805b3569163 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:28.423210 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fe125514-613e-4938-a81c-8805b3569163 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:28.423984 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fe125514-613e-4938-a81c-8805b3569163 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:28.424423 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fe125514-613e-4938-a81c-8805b3569163 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:28.559272 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-fe125514-613e-4938-a81c-8805b3569163 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:57:28.566560 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-fe125514-613e-4938-a81c-8805b3569163 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab" status: 200 len: 1578 microversion: 2.1 time: 0.154132 May 12 11:57:28.567126 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 509/1021] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:57:28 2022] GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:57:29.589314 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-e269630b-d387-44f7-bf93-5f4eba394def tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:57:29.590521 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-e269630b-d387-44f7-bf93-5f4eba394def tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:57:29.602302 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e269630b-d387-44f7-bf93-5f4eba394def tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:29.603104 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e269630b-d387-44f7-bf93-5f4eba394def tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:29.604479 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e269630b-d387-44f7-bf93-5f4eba394def tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:29.605271 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-e269630b-d387-44f7-bf93-5f4eba394def tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:29.738469 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-e269630b-d387-44f7-bf93-5f4eba394def tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:57:29.747441 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-e269630b-d387-44f7-bf93-5f4eba394def tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab" status: 200 len: 1578 microversion: 2.1 time: 0.166558 May 12 11:57:29.748054 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 513/1022] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:57:29 2022] GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:57:30.764545 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-f053203f-7948-4112-adb8-d268781cb23f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:57:30.765188 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-f053203f-7948-4112-adb8-d268781cb23f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:57:30.771822 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f053203f-7948-4112-adb8-d268781cb23f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:30.772273 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f053203f-7948-4112-adb8-d268781cb23f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:30.773080 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f053203f-7948-4112-adb8-d268781cb23f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:30.773515 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-f053203f-7948-4112-adb8-d268781cb23f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:30.840404 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-f053203f-7948-4112-adb8-d268781cb23f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:57:30.847990 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-f053203f-7948-4112-adb8-d268781cb23f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab" status: 200 len: 1510 microversion: 2.1 time: 0.087215 May 12 11:57:30.857734 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 510/1023] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:57:30 2022] GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab => generated 1510 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:57:30.963419 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-0036b485-d4b6-4b52-94ee-dbca691b15fb req-180497ae-94ef-4912-a8ea-bed461b23a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08861685-923b-4ae7-ac93-e58799f637ab", "name": "network-vif-deleted", "tag": "f39ce636-63c4-4a0e-a9ba-46a28d7f11e1"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:57:30.981488 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-0036b485-d4b6-4b52-94ee-dbca691b15fb req-180497ae-94ef-4912-a8ea-bed461b23a97 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:30.982195 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-0036b485-d4b6-4b52-94ee-dbca691b15fb req-180497ae-94ef-4912-a8ea-bed461b23a97 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:31.000842 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-0036b485-d4b6-4b52-94ee-dbca691b15fb req-180497ae-94ef-4912-a8ea-bed461b23a97 service nova] Creating event network-vif-deleted:f39ce636-63c4-4a0e-a9ba-46a28d7f11e1 for instance 08861685-923b-4ae7-ac93-e58799f637ab on hv-cinder-80473 May 12 11:57:31.007317 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-0036b485-d4b6-4b52-94ee-dbca691b15fb req-180497ae-94ef-4912-a8ea-bed461b23a97 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047889 May 12 11:57:31.012406 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 514/1024] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:57:31.865314 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-588ae4e0-6a89-4535-99a4-0b763a6b39f7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:57:31.865950 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-588ae4e0-6a89-4535-99a4-0b763a6b39f7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:57:31.873081 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-588ae4e0-6a89-4535-99a4-0b763a6b39f7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:31.873530 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-588ae4e0-6a89-4535-99a4-0b763a6b39f7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:31.874338 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-588ae4e0-6a89-4535-99a4-0b763a6b39f7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:31.874770 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-588ae4e0-6a89-4535-99a4-0b763a6b39f7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:31.889750 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-588ae4e0-6a89-4535-99a4-0b763a6b39f7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] HTTP exception thrown: Instance 08861685-923b-4ae7-ac93-e58799f637ab could not be found. May 12 11:57:31.891574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-588ae4e0-6a89-4535-99a4-0b763a6b39f7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Request method failure captured: May 12 11:57:31.891574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab HTTP/1.1 May 12 11:57:31.891574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 11:57:31.891574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 11:57:31.891574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 11:57:31.891574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 0 May 12 11:57:31.891574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 11:57:31.891574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 11:57:31.891574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 11:57:31.891574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 11:57:31.891574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPWL8OnqDnmwYgCgjxLIlhwqAo5ZG3lmf_-Pcie_BprC53ar7_a_-vV6BIbnllRdm9elV2kVnhXq6PFaOSFPs-fxxao0jwLD7lBO5x4I9UNFuy_7bA8AaP5B7_HC-ZfmUhVwqs7CCs_nVRoFalYYs8k1Q9RDrC19dPhoJFrEhvrcdss May 12 11:57:31.891574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 11:57:31.891574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 11:57:31.891574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 11:57:31.891574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 11:57:31.891574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 11:57:31.891574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 11:57:31.891574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: 7d148f892d044444b6be65537ba8b335 May 12 11:57:31.891574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-TestVolumeBootPattern-2058455156 May 12 11:57:31.891574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 11:57:31.891574 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 11:57:31.893324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d148f892d044444b6be65537ba8b335"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d148f892d044444b6be65537ba8b335"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d148f892d044444b6be65537ba8b335"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d148f892d044444b6be65537ba8b335", "adminURL": "http://10.222.0.58:8080"}]}] May 12 11:57:31.893324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-TestVolumeBootPattern-2058455156 May 12 11:57:31.893324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: 7d148f892d044444b6be65537ba8b335 May 12 11:57:31.893324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-TestVolumeBootPattern-2058455156 May 12 11:57:31.893324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-TestVolumeBootPattern-2058455156-project May 12 11:57:31.893324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 11:57:31.893324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 11:57:31.893324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: f6b3ad012ab1404b88e4b36c80a02a05 May 12 11:57:31.893324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-TestVolumeBootPattern-2058455156-project May 12 11:57:31.893324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: > May 12 11:57:31.893324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Instance 08861685-923b-4ae7-ac93-e58799f637ab could not be found. May 12 11:57:31.893324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'id': '08861685-923b-4ae7-ac93-e58799f637ab'} May 12 11:57:31.894383 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 11:57:31.894383 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:57:31.894383 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 11:57:31.894383 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 11:57:31.894383 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 11:57:31.894383 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 11:57:31.894383 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 11:57:31.894383 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 11:57:31.894383 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 11:57:31.894383 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 11:57:31.894383 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08861685-923b-4ae7-ac93-e58799f637ab could not be found. May 12 11:57:31.894383 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:57:31.894383 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:57:31.894383 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:57:31.894383 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:57:31.894383 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:57:31.894383 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:57:31.894383 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 11:57:31.894383 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 11:57:31.894383 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 11:57:31.895718 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 11:57:31.895718 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 11:57:31.895718 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 11:57:31.895718 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 11:57:31.895718 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 11:57:31.895718 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 11:57:31.895718 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 11:57:31.895718 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08861685-923b-4ae7-ac93-e58799f637ab could not be found. May 12 11:57:31.895718 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:57:31.895718 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 11:57:31.895718 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:57:31.895718 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 11:57:31.895718 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 11:57:31.895718 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 11:57:31.895718 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 11:57:31.895718 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 11:57:31.895718 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08861685-923b-4ae7-ac93-e58799f637ab could not be found. May 12 11:57:31.895718 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 11:57:31.897827 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-588ae4e0-6a89-4535-99a4-0b763a6b39f7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Returning 404 to user: Instance 08861685-923b-4ae7-ac93-e58799f637ab could not be found. {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 11:57:31.898800 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-588ae4e0-6a89-4535-99a4-0b763a6b39f7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab" status: 404 len: 111 microversion: 2.1 time: 0.037325 May 12 11:57:31.899366 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 511/1025] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:57:31 2022] GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 11:57:31.994069 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-5f94ad25-48d6-480d-8bc5-dd0d06a26c1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1938690293", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-219476055", "security_groups": [{"name": "tempest-secgroup-smoke-1098863337"}], "block_device_mapping_v2": [{"uuid": "a70e7037-c337-4669-abdb-e067fb0917fe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2251d509-6705-4760-a42b-7398b2cf420e"}]}} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:57:32.104413 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.network.neutron [None req-5f94ad25-48d6-480d-8bc5-dd0d06a26c1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] validate_networks() for [('2251d509-6705-4760-a42b-7398b2cf420e', None, None, None, None, None)] {{(pid=123508) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 11:57:32.471065 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-5f94ad25-48d6-480d-8bc5-dd0d06a26c1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Flavor limits 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 11:57:32.471484 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-5f94ad25-48d6-480d-8bc5-dd0d06a26c1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Image limits 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 11:57:32.472014 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-5f94ad25-48d6-480d-8bc5-dd0d06a26c1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Flavor pref 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 11:57:32.472424 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-5f94ad25-48d6-480d-8bc5-dd0d06a26c1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Image pref 0:0:0 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 11:57:32.472837 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.virt.hardware [None req-5f94ad25-48d6-480d-8bc5-dd0d06a26c1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123508) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 11:57:32.481985 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5f94ad25-48d6-480d-8bc5-dd0d06a26c1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:32.482443 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5f94ad25-48d6-480d-8bc5-dd0d06a26c1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:32.483373 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5f94ad25-48d6-480d-8bc5-dd0d06a26c1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:32.484041 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5f94ad25-48d6-480d-8bc5-dd0d06a26c1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:32.501423 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-5f94ad25-48d6-480d-8bc5-dd0d06a26c1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Getting quotas for project 7d148f892d044444b6be65537ba8b335. Resources: {'ram', 'cores', 'instances'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:57:32.505981 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.quota [None req-5f94ad25-48d6-480d-8bc5-dd0d06a26c1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Getting quotas for user f6b3ad012ab1404b88e4b36c80a02a05 and project 7d148f892d044444b6be65537ba8b335. Resources: {'ram', 'cores', 'instances'} {{(pid=123508) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:57:32.564137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-5f94ad25-48d6-480d-8bc5-dd0d06a26c1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Going to run 1 instances... {{(pid=123508) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 11:57:32.566326 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-5f94ad25-48d6-480d-8bc5-dd0d06a26c1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: e38e78e7-9790-415b-a254-a5b794734d23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a70e7037-c337-4669-abdb-e067fb0917fe',volume_size=None,volume_type=None)] {{(pid=123508) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 11:57:32.691721 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-5f94ad25-48d6-480d-8bc5-dd0d06a26c1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.702832 May 12 11:57:32.692581 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 515/1026] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 12 11:57:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 11:57:32.703585 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-f2e134e8-ce12-4127-8155-a2d033e3ecad tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:57:32.704202 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-f2e134e8-ce12-4127-8155-a2d033e3ecad tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: e38e78e7-9790-415b-a254-a5b794734d23] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:57:32.768053 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-f2e134e8-ce12-4127-8155-a2d033e3ecad tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:57:32.774767 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-f2e134e8-ce12-4127-8155-a2d033e3ecad tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23" status: 200 len: 1094 microversion: 2.1 time: 0.074924 May 12 11:57:32.775429 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 512/1027] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:57:32 2022] GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:57:33.792934 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-3900065a-12bc-42b6-91bb-92a7e304d4aa tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:57:33.793550 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-3900065a-12bc-42b6-91bb-92a7e304d4aa tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: e38e78e7-9790-415b-a254-a5b794734d23] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:57:33.800331 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3900065a-12bc-42b6-91bb-92a7e304d4aa tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:33.800850 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3900065a-12bc-42b6-91bb-92a7e304d4aa tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:33.801854 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3900065a-12bc-42b6-91bb-92a7e304d4aa tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:33.802358 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-3900065a-12bc-42b6-91bb-92a7e304d4aa tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:33.871150 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-3900065a-12bc-42b6-91bb-92a7e304d4aa tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:57:33.879359 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-3900065a-12bc-42b6-91bb-92a7e304d4aa tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23" status: 200 len: 1210 microversion: 2.1 time: 0.091394 May 12 11:57:33.879932 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 516/1028] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:57:33 2022] GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23 => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:57:34.897017 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-9bd0e6dc-5f4d-4cf9-b959-6e227807b465 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:57:34.898470 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-9bd0e6dc-5f4d-4cf9-b959-6e227807b465 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: e38e78e7-9790-415b-a254-a5b794734d23] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:57:34.912176 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9bd0e6dc-5f4d-4cf9-b959-6e227807b465 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:34.912635 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9bd0e6dc-5f4d-4cf9-b959-6e227807b465 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:34.914142 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9bd0e6dc-5f4d-4cf9-b959-6e227807b465 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:34.914585 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-9bd0e6dc-5f4d-4cf9-b959-6e227807b465 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:35.172319 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-9bd0e6dc-5f4d-4cf9-b959-6e227807b465 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:57:35.180507 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-9bd0e6dc-5f4d-4cf9-b959-6e227807b465 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23" status: 200 len: 1266 microversion: 2.1 time: 0.287569 May 12 11:57:35.181323 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 513/1029] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:57:34 2022] GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:57:35.267921 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-ec8cbbf8-ab5f-469a-b495-4fd38e4c90bc req-3badfd8a-3d7b-49f4-8142-d8d953af3528 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e38e78e7-9790-415b-a254-a5b794734d23", "tag": "d5593789-16d7-43e5-a19d-5bf1ce2948cc"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:57:35.286358 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-ec8cbbf8-ab5f-469a-b495-4fd38e4c90bc req-3badfd8a-3d7b-49f4-8142-d8d953af3528 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:35.287266 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-ec8cbbf8-ab5f-469a-b495-4fd38e4c90bc req-3badfd8a-3d7b-49f4-8142-d8d953af3528 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:35.307423 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-ec8cbbf8-ab5f-469a-b495-4fd38e4c90bc req-3badfd8a-3d7b-49f4-8142-d8d953af3528 service nova] Creating event network-changed:d5593789-16d7-43e5-a19d-5bf1ce2948cc for instance e38e78e7-9790-415b-a254-a5b794734d23 on hv-cinder-80473 May 12 11:57:35.313300 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-ec8cbbf8-ab5f-469a-b495-4fd38e4c90bc req-3badfd8a-3d7b-49f4-8142-d8d953af3528 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048990 May 12 11:57:35.314082 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 517/1030] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:57:36.198060 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-43ae4587-49b6-49c5-b654-b24e63dfaf33 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:57:36.199282 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-43ae4587-49b6-49c5-b654-b24e63dfaf33 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: e38e78e7-9790-415b-a254-a5b794734d23] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:57:36.205104 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-43ae4587-49b6-49c5-b654-b24e63dfaf33 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:36.205543 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-43ae4587-49b6-49c5-b654-b24e63dfaf33 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:36.206345 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-43ae4587-49b6-49c5-b654-b24e63dfaf33 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:36.206774 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-43ae4587-49b6-49c5-b654-b24e63dfaf33 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:36.445376 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-43ae4587-49b6-49c5-b654-b24e63dfaf33 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:57:36.466787 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-43ae4587-49b6-49c5-b654-b24e63dfaf33 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23" status: 200 len: 1266 microversion: 2.1 time: 0.267717 May 12 11:57:36.474100 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 514/1031] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:57:36 2022] GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23 => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:57:37.485496 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-d005f0bf-5a42-45c1-a8e3-a241f3fbc62c tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:57:37.486225 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-d005f0bf-5a42-45c1-a8e3-a241f3fbc62c tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: e38e78e7-9790-415b-a254-a5b794734d23] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:57:37.492323 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d005f0bf-5a42-45c1-a8e3-a241f3fbc62c tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:37.492771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d005f0bf-5a42-45c1-a8e3-a241f3fbc62c tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:37.493536 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d005f0bf-5a42-45c1-a8e3-a241f3fbc62c tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:37.494001 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-d005f0bf-5a42-45c1-a8e3-a241f3fbc62c tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:37.621591 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-d005f0bf-5a42-45c1-a8e3-a241f3fbc62c tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:57:37.628883 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-d005f0bf-5a42-45c1-a8e3-a241f3fbc62c tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23" status: 200 len: 1266 microversion: 2.1 time: 0.148007 May 12 11:57:37.629449 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 518/1032] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:57:37 2022] GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:57:38.646620 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-42c3a43f-4824-462d-9d9e-bd08b7750e88 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:57:38.647272 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-42c3a43f-4824-462d-9d9e-bd08b7750e88 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: e38e78e7-9790-415b-a254-a5b794734d23] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:57:38.654475 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-42c3a43f-4824-462d-9d9e-bd08b7750e88 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:38.654930 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-42c3a43f-4824-462d-9d9e-bd08b7750e88 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:38.655746 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-42c3a43f-4824-462d-9d9e-bd08b7750e88 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:38.656187 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-42c3a43f-4824-462d-9d9e-bd08b7750e88 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:38.788002 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-42c3a43f-4824-462d-9d9e-bd08b7750e88 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:57:38.795207 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-42c3a43f-4824-462d-9d9e-bd08b7750e88 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23" status: 200 len: 1266 microversion: 2.1 time: 0.153368 May 12 11:57:38.795857 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 515/1033] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:57:38 2022] GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:57:39.815088 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-9ecc31c6-cdc1-4ed5-8ec4-a35f130026e2 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:57:39.815685 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-9ecc31c6-cdc1-4ed5-8ec4-a35f130026e2 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: e38e78e7-9790-415b-a254-a5b794734d23] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:57:39.822721 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9ecc31c6-cdc1-4ed5-8ec4-a35f130026e2 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:39.823173 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9ecc31c6-cdc1-4ed5-8ec4-a35f130026e2 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:39.823940 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9ecc31c6-cdc1-4ed5-8ec4-a35f130026e2 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:39.824376 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9ecc31c6-cdc1-4ed5-8ec4-a35f130026e2 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:40.232573 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-9ecc31c6-cdc1-4ed5-8ec4-a35f130026e2 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:57:40.239726 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-9ecc31c6-cdc1-4ed5-8ec4-a35f130026e2 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23" status: 200 len: 1266 microversion: 2.1 time: 0.429615 May 12 11:57:40.240276 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 519/1034] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:57:39 2022] GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23 => generated 1266 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:57:41.256648 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-47a5a2b2-d64b-44b1-877c-19adad988b97 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:57:41.257259 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-47a5a2b2-d64b-44b1-877c-19adad988b97 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: e38e78e7-9790-415b-a254-a5b794734d23] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:57:41.263637 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-47a5a2b2-d64b-44b1-877c-19adad988b97 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:41.264083 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-47a5a2b2-d64b-44b1-877c-19adad988b97 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:41.264849 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-47a5a2b2-d64b-44b1-877c-19adad988b97 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:41.265283 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-47a5a2b2-d64b-44b1-877c-19adad988b97 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:41.393918 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-47a5a2b2-d64b-44b1-877c-19adad988b97 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:57:41.401961 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-47a5a2b2-d64b-44b1-877c-19adad988b97 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23" status: 200 len: 1266 microversion: 2.1 time: 0.148960 May 12 11:57:41.402500 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 516/1035] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:57:41 2022] GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:57:42.418529 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-4d1d7c6c-8b4c-4646-b5dc-881e649cbd34 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:57:42.419138 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-4d1d7c6c-8b4c-4646-b5dc-881e649cbd34 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: e38e78e7-9790-415b-a254-a5b794734d23] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:57:42.425661 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4d1d7c6c-8b4c-4646-b5dc-881e649cbd34 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:42.426164 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4d1d7c6c-8b4c-4646-b5dc-881e649cbd34 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:42.426996 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4d1d7c6c-8b4c-4646-b5dc-881e649cbd34 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:42.427435 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-4d1d7c6c-8b4c-4646-b5dc-881e649cbd34 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:42.566278 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-4d1d7c6c-8b4c-4646-b5dc-881e649cbd34 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:57:42.574859 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-4d1d7c6c-8b4c-4646-b5dc-881e649cbd34 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23" status: 200 len: 1266 microversion: 2.1 time: 0.160198 May 12 11:57:42.575430 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 520/1036] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:57:42 2022] GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:57:43.591889 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-b0a0273e-8877-467e-b690-5db37855443e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:57:43.592522 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-b0a0273e-8877-467e-b690-5db37855443e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: e38e78e7-9790-415b-a254-a5b794734d23] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:57:43.599151 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b0a0273e-8877-467e-b690-5db37855443e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:43.599595 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b0a0273e-8877-467e-b690-5db37855443e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:43.600351 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b0a0273e-8877-467e-b690-5db37855443e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:43.600814 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b0a0273e-8877-467e-b690-5db37855443e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:43.733854 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b0a0273e-8877-467e-b690-5db37855443e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:57:43.743262 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-b0a0273e-8877-467e-b690-5db37855443e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23" status: 200 len: 1266 microversion: 2.1 time: 0.155030 May 12 11:57:43.744190 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 517/1037] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:57:43 2022] GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:57:44.760621 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-c228cae7-12a8-49eb-ae9f-2ffef2e78fc0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:57:44.761220 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-c228cae7-12a8-49eb-ae9f-2ffef2e78fc0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: e38e78e7-9790-415b-a254-a5b794734d23] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:57:44.767656 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c228cae7-12a8-49eb-ae9f-2ffef2e78fc0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:44.768104 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c228cae7-12a8-49eb-ae9f-2ffef2e78fc0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:44.769153 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c228cae7-12a8-49eb-ae9f-2ffef2e78fc0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:44.769280 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-c228cae7-12a8-49eb-ae9f-2ffef2e78fc0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:44.902178 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-c228cae7-12a8-49eb-ae9f-2ffef2e78fc0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:57:44.909953 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-c228cae7-12a8-49eb-ae9f-2ffef2e78fc0 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23" status: 200 len: 1266 microversion: 2.1 time: 0.153592 May 12 11:57:44.910840 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 521/1038] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:57:44 2022] GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:57:45.926868 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-e088100f-948e-4419-ad08-00fd60c2d79a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:57:45.927483 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-e088100f-948e-4419-ad08-00fd60c2d79a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: e38e78e7-9790-415b-a254-a5b794734d23] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:57:45.934314 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e088100f-948e-4419-ad08-00fd60c2d79a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:45.934762 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e088100f-948e-4419-ad08-00fd60c2d79a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:45.935533 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e088100f-948e-4419-ad08-00fd60c2d79a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:45.935971 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-e088100f-948e-4419-ad08-00fd60c2d79a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:46.066481 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-e088100f-948e-4419-ad08-00fd60c2d79a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:57:46.075377 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-e088100f-948e-4419-ad08-00fd60c2d79a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23" status: 200 len: 1266 microversion: 2.1 time: 0.152275 May 12 11:57:46.076324 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 518/1039] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:57:45 2022] GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:57:46.215992 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-926744a8-ebdf-425f-8125-9279f4e15774 req-dc5f5f60-edaa-4330-a8ee-84f54ee60a60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e38e78e7-9790-415b-a254-a5b794734d23", "name": "network-vif-plugged", "status": "completed", "tag": "d5593789-16d7-43e5-a19d-5bf1ce2948cc"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:57:46.225202 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-926744a8-ebdf-425f-8125-9279f4e15774 req-dc5f5f60-edaa-4330-a8ee-84f54ee60a60 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:46.225653 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-926744a8-ebdf-425f-8125-9279f4e15774 req-dc5f5f60-edaa-4330-a8ee-84f54ee60a60 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:46.239445 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-926744a8-ebdf-425f-8125-9279f4e15774 req-dc5f5f60-edaa-4330-a8ee-84f54ee60a60 service nova] Creating event network-vif-plugged:d5593789-16d7-43e5-a19d-5bf1ce2948cc for instance e38e78e7-9790-415b-a254-a5b794734d23 on hv-cinder-80473 May 12 11:57:46.244400 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-926744a8-ebdf-425f-8125-9279f4e15774 req-dc5f5f60-edaa-4330-a8ee-84f54ee60a60 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033881 May 12 11:57:46.244997 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 522/1040] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:57:47.092521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-44f21e2a-6118-48d2-96a3-3c87979f2433 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:57:47.093144 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-44f21e2a-6118-48d2-96a3-3c87979f2433 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: e38e78e7-9790-415b-a254-a5b794734d23] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:57:47.099764 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-44f21e2a-6118-48d2-96a3-3c87979f2433 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:47.100213 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-44f21e2a-6118-48d2-96a3-3c87979f2433 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:47.100977 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-44f21e2a-6118-48d2-96a3-3c87979f2433 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:47.101417 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-44f21e2a-6118-48d2-96a3-3c87979f2433 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:47.225848 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-44f21e2a-6118-48d2-96a3-3c87979f2433 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:57:47.233027 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-44f21e2a-6118-48d2-96a3-3c87979f2433 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23" status: 200 len: 1266 microversion: 2.1 time: 0.144413 May 12 11:57:47.233582 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 519/1041] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:57:47 2022] GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 11:57:48.250387 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-f8852cc3-d726-430c-947f-bbfd4c6e48f1 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:57:48.251079 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-f8852cc3-d726-430c-947f-bbfd4c6e48f1 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: e38e78e7-9790-415b-a254-a5b794734d23] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:57:48.257940 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f8852cc3-d726-430c-947f-bbfd4c6e48f1 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:48.258399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f8852cc3-d726-430c-947f-bbfd4c6e48f1 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:48.259167 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f8852cc3-d726-430c-947f-bbfd4c6e48f1 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:48.259611 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-f8852cc3-d726-430c-947f-bbfd4c6e48f1 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:48.405684 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-f8852cc3-d726-430c-947f-bbfd4c6e48f1 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:57:48.412904 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-f8852cc3-d726-430c-947f-bbfd4c6e48f1 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23" status: 200 len: 1453 microversion: 2.1 time: 0.167243 May 12 11:57:48.413474 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 523/1042] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:57:48 2022] GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23 => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:57:48.428613 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-7aa78ab3-9076-480c-a636-98fde4d0e1f9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:57:48.429730 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-7aa78ab3-9076-480c-a636-98fde4d0e1f9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: e38e78e7-9790-415b-a254-a5b794734d23] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:57:48.435987 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7aa78ab3-9076-480c-a636-98fde4d0e1f9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:48.436429 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7aa78ab3-9076-480c-a636-98fde4d0e1f9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:48.437211 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7aa78ab3-9076-480c-a636-98fde4d0e1f9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:48.437638 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-7aa78ab3-9076-480c-a636-98fde4d0e1f9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:48.566193 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-7aa78ab3-9076-480c-a636-98fde4d0e1f9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:57:48.575376 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-7aa78ab3-9076-480c-a636-98fde4d0e1f9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23" status: 200 len: 1453 microversion: 2.1 time: 0.150257 May 12 11:57:48.576377 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 520/1043] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:57:48 2022] GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:57:50.630142 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-1ae7b1bb-88ec-4423-9158-33afc5b57b38 req-bb1697aa-48b6-49a8-942c-3ab326d5f1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e38e78e7-9790-415b-a254-a5b794734d23", "tag": "d5593789-16d7-43e5-a19d-5bf1ce2948cc"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:57:50.643678 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-1ae7b1bb-88ec-4423-9158-33afc5b57b38 req-bb1697aa-48b6-49a8-942c-3ab326d5f1a2 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:57:50.644698 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-1ae7b1bb-88ec-4423-9158-33afc5b57b38 req-bb1697aa-48b6-49a8-942c-3ab326d5f1a2 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:57:50.659027 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-1ae7b1bb-88ec-4423-9158-33afc5b57b38 req-bb1697aa-48b6-49a8-942c-3ab326d5f1a2 service nova] Creating event network-changed:d5593789-16d7-43e5-a19d-5bf1ce2948cc for instance e38e78e7-9790-415b-a254-a5b794734d23 on hv-cinder-80473 May 12 11:57:50.664670 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-1ae7b1bb-88ec-4423-9158-33afc5b57b38 req-bb1697aa-48b6-49a8-942c-3ab326d5f1a2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037904 May 12 11:57:50.665278 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 524/1044] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:59:24.619136 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-58148a90-e1a3-46d8-b78b-1f5f6b3f9027 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-215622026", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-219476055", "security_groups": [{"name": "tempest-secgroup-smoke-1098863337"}], "block_device_mapping_v2": [{"uuid": "c625f0c2-1e17-4f29-833c-36777875d77a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2251d509-6705-4760-a42b-7398b2cf420e"}]}} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:59:24.727762 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.network.neutron [None req-58148a90-e1a3-46d8-b78b-1f5f6b3f9027 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] validate_networks() for [('2251d509-6705-4760-a42b-7398b2cf420e', None, None, None, None, None)] {{(pid=123507) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 11:59:25.189141 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-58148a90-e1a3-46d8-b78b-1f5f6b3f9027 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Flavor limits 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 11:59:25.189565 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-58148a90-e1a3-46d8-b78b-1f5f6b3f9027 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Image limits 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 11:59:25.190093 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-58148a90-e1a3-46d8-b78b-1f5f6b3f9027 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Flavor pref 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 11:59:25.190507 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-58148a90-e1a3-46d8-b78b-1f5f6b3f9027 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Image pref 0:0:0 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 11:59:25.190916 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.virt.hardware [None req-58148a90-e1a3-46d8-b78b-1f5f6b3f9027 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123507) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 11:59:25.199414 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-58148a90-e1a3-46d8-b78b-1f5f6b3f9027 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:25.199863 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-58148a90-e1a3-46d8-b78b-1f5f6b3f9027 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:25.200668 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-58148a90-e1a3-46d8-b78b-1f5f6b3f9027 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:25.201105 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-58148a90-e1a3-46d8-b78b-1f5f6b3f9027 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:25.217321 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-58148a90-e1a3-46d8-b78b-1f5f6b3f9027 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Getting quotas for project 7d148f892d044444b6be65537ba8b335. Resources: {'ram', 'cores', 'instances'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 11:59:25.221807 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.quota [None req-58148a90-e1a3-46d8-b78b-1f5f6b3f9027 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Getting quotas for user f6b3ad012ab1404b88e4b36c80a02a05 and project 7d148f892d044444b6be65537ba8b335. Resources: {'ram', 'cores', 'instances'} {{(pid=123507) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 11:59:25.277488 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-58148a90-e1a3-46d8-b78b-1f5f6b3f9027 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Going to run 1 instances... {{(pid=123507) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 11:59:25.279585 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-58148a90-e1a3-46d8-b78b-1f5f6b3f9027 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 929f91fd-fef7-44e8-8408-763b6b9f1756] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c625f0c2-1e17-4f29-833c-36777875d77a',volume_size=None,volume_type=None)] {{(pid=123507) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 11:59:25.399193 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR oslo.messaging._drivers.impl_rabbit [None req-58148a90-e1a3-46d8-b78b-1f5f6b3f9027 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [658056f1-2e7a-4b91-8e44-d5726bc59426] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 12 11:59:26.407099 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO oslo.messaging._drivers.impl_rabbit [None req-58148a90-e1a3-46d8-b78b-1f5f6b3f9027 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [658056f1-2e7a-4b91-8e44-d5726bc59426] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 48720. May 12 11:59:26.410845 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-58148a90-e1a3-46d8-b78b-1f5f6b3f9027 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.796535 May 12 11:59:26.411512 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 521/1045] 10.222.0.58 () {60 vars in 1146 bytes} [Thu May 12 11:59:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 11:59:26.423094 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-8a7e5528-4e76-4ddd-b37a-59fa5a5c560c tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:59:26.423788 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-8a7e5528-4e76-4ddd-b37a-59fa5a5c560c tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 929f91fd-fef7-44e8-8408-763b6b9f1756] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:59:26.477190 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8a7e5528-4e76-4ddd-b37a-59fa5a5c560c tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:59:26.484008 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-8a7e5528-4e76-4ddd-b37a-59fa5a5c560c tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756" status: 200 len: 1093 microversion: 2.1 time: 0.066397 May 12 11:59:26.484593 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 525/1046] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:59:26 2022] GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:59:27.500395 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-cb2b1b26-a806-4560-adb5-5c64dcb5aac9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:59:27.501306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-cb2b1b26-a806-4560-adb5-5c64dcb5aac9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 929f91fd-fef7-44e8-8408-763b6b9f1756] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:59:27.508679 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cb2b1b26-a806-4560-adb5-5c64dcb5aac9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:27.509246 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cb2b1b26-a806-4560-adb5-5c64dcb5aac9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:27.510293 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cb2b1b26-a806-4560-adb5-5c64dcb5aac9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:27.510822 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cb2b1b26-a806-4560-adb5-5c64dcb5aac9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:27.584124 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-cb2b1b26-a806-4560-adb5-5c64dcb5aac9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:59:27.591223 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-cb2b1b26-a806-4560-adb5-5c64dcb5aac9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756" status: 200 len: 1209 microversion: 2.1 time: 0.094745 May 12 11:59:27.591783 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 522/1047] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:59:27 2022] GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756 => generated 1209 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:59:28.612303 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-926217dc-c6e3-4480-a76d-fa3294e51f7a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:59:28.612921 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-926217dc-c6e3-4480-a76d-fa3294e51f7a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 929f91fd-fef7-44e8-8408-763b6b9f1756] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:59:28.620334 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-926217dc-c6e3-4480-a76d-fa3294e51f7a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:28.620793 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-926217dc-c6e3-4480-a76d-fa3294e51f7a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:28.621604 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-926217dc-c6e3-4480-a76d-fa3294e51f7a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:28.622092 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-926217dc-c6e3-4480-a76d-fa3294e51f7a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:28.770673 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-926217dc-c6e3-4480-a76d-fa3294e51f7a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:59:28.779027 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-926217dc-c6e3-4480-a76d-fa3294e51f7a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756" status: 200 len: 1265 microversion: 2.1 time: 0.170690 May 12 11:59:28.780358 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 526/1048] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:59:28 2022] GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:59:28.857504 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [req-954f5495-2a70-421f-a013-f568f994b320 req-5216dafb-99b1-431f-979b-2bbd33527192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "929f91fd-fef7-44e8-8408-763b6b9f1756", "tag": "2316771b-57d5-4858-92fd-b8bf2c80c60b"}]} {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:59:28.868379 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-954f5495-2a70-421f-a013-f568f994b320 req-5216dafb-99b1-431f-979b-2bbd33527192 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:28.868889 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [req-954f5495-2a70-421f-a013-f568f994b320 req-5216dafb-99b1-431f-979b-2bbd33527192 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:28.882705 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.compute.server_external_events [req-954f5495-2a70-421f-a013-f568f994b320 req-5216dafb-99b1-431f-979b-2bbd33527192 service nova] Creating event network-changed:2316771b-57d5-4858-92fd-b8bf2c80c60b for instance 929f91fd-fef7-44e8-8408-763b6b9f1756 on hv-cinder-80473 May 12 11:59:28.888411 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [req-954f5495-2a70-421f-a013-f568f994b320 req-5216dafb-99b1-431f-979b-2bbd33527192 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042773 May 12 11:59:28.889340 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 523/1049] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 11:59:29.796846 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-7c913e9c-e93e-4917-a6e8-eacea54ef815 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:59:29.797461 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-7c913e9c-e93e-4917-a6e8-eacea54ef815 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 929f91fd-fef7-44e8-8408-763b6b9f1756] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:59:29.803872 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7c913e9c-e93e-4917-a6e8-eacea54ef815 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:29.804313 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7c913e9c-e93e-4917-a6e8-eacea54ef815 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:29.805091 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7c913e9c-e93e-4917-a6e8-eacea54ef815 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:29.805523 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7c913e9c-e93e-4917-a6e8-eacea54ef815 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:29.936885 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-7c913e9c-e93e-4917-a6e8-eacea54ef815 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:59:29.944094 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-7c913e9c-e93e-4917-a6e8-eacea54ef815 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756" status: 200 len: 1265 microversion: 2.1 time: 0.151964 May 12 11:59:29.944660 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 527/1050] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:59:29 2022] GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:59:30.961190 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-1b5d317a-1d1e-4e18-9b29-ad70e34f8c68 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:59:30.961839 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-1b5d317a-1d1e-4e18-9b29-ad70e34f8c68 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 929f91fd-fef7-44e8-8408-763b6b9f1756] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:59:30.968375 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1b5d317a-1d1e-4e18-9b29-ad70e34f8c68 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:30.968829 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1b5d317a-1d1e-4e18-9b29-ad70e34f8c68 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:30.969595 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1b5d317a-1d1e-4e18-9b29-ad70e34f8c68 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:30.970060 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-1b5d317a-1d1e-4e18-9b29-ad70e34f8c68 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:31.098931 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-1b5d317a-1d1e-4e18-9b29-ad70e34f8c68 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:59:31.106485 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-1b5d317a-1d1e-4e18-9b29-ad70e34f8c68 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756" status: 200 len: 1265 microversion: 2.1 time: 0.149606 May 12 11:59:31.107048 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 524/1051] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:59:30 2022] GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:59:32.123566 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-8e833b90-5f2d-4ef3-a870-5a49952d71ed tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:59:32.124188 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-8e833b90-5f2d-4ef3-a870-5a49952d71ed tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 929f91fd-fef7-44e8-8408-763b6b9f1756] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:59:32.131261 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8e833b90-5f2d-4ef3-a870-5a49952d71ed tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:32.131716 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8e833b90-5f2d-4ef3-a870-5a49952d71ed tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:32.132484 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8e833b90-5f2d-4ef3-a870-5a49952d71ed tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:32.132928 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8e833b90-5f2d-4ef3-a870-5a49952d71ed tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:32.258887 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8e833b90-5f2d-4ef3-a870-5a49952d71ed tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:59:32.266880 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-8e833b90-5f2d-4ef3-a870-5a49952d71ed tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756" status: 200 len: 1265 microversion: 2.1 time: 0.147217 May 12 11:59:32.267445 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 528/1052] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:59:32 2022] GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:59:33.283477 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-b0380c99-073b-46a1-9daf-13138374b904 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:59:33.284094 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-b0380c99-073b-46a1-9daf-13138374b904 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 929f91fd-fef7-44e8-8408-763b6b9f1756] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:59:33.290472 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b0380c99-073b-46a1-9daf-13138374b904 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:33.290915 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b0380c99-073b-46a1-9daf-13138374b904 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:33.291673 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b0380c99-073b-46a1-9daf-13138374b904 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:33.292106 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b0380c99-073b-46a1-9daf-13138374b904 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:33.417519 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b0380c99-073b-46a1-9daf-13138374b904 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:59:33.425498 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-b0380c99-073b-46a1-9daf-13138374b904 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756" status: 200 len: 1265 microversion: 2.1 time: 0.145936 May 12 11:59:33.426108 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 525/1053] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:59:33 2022] GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:59:34.444575 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-5e0da26c-2cf3-4c1a-a160-48c5c347cc68 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:59:34.445212 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-5e0da26c-2cf3-4c1a-a160-48c5c347cc68 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 929f91fd-fef7-44e8-8408-763b6b9f1756] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:59:34.451627 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5e0da26c-2cf3-4c1a-a160-48c5c347cc68 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:34.452080 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5e0da26c-2cf3-4c1a-a160-48c5c347cc68 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:34.452855 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5e0da26c-2cf3-4c1a-a160-48c5c347cc68 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:34.453910 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-5e0da26c-2cf3-4c1a-a160-48c5c347cc68 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:34.584052 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-5e0da26c-2cf3-4c1a-a160-48c5c347cc68 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:59:34.591439 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-5e0da26c-2cf3-4c1a-a160-48c5c347cc68 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756" status: 200 len: 1265 microversion: 2.1 time: 0.150694 May 12 11:59:34.592037 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 529/1054] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:59:34 2022] GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:59:35.608595 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-3036a469-cdb1-4c8b-86a0-7752d18da4a7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:59:35.609209 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-3036a469-cdb1-4c8b-86a0-7752d18da4a7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 929f91fd-fef7-44e8-8408-763b6b9f1756] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:59:35.615858 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3036a469-cdb1-4c8b-86a0-7752d18da4a7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:35.616316 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3036a469-cdb1-4c8b-86a0-7752d18da4a7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:35.617083 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3036a469-cdb1-4c8b-86a0-7752d18da4a7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:35.617521 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3036a469-cdb1-4c8b-86a0-7752d18da4a7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:35.747965 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-3036a469-cdb1-4c8b-86a0-7752d18da4a7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:59:35.755774 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-3036a469-cdb1-4c8b-86a0-7752d18da4a7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756" status: 200 len: 1265 microversion: 2.1 time: 0.151372 May 12 11:59:35.756288 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 526/1055] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:59:35 2022] GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:59:36.772844 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-9194926d-2526-4d43-a15c-732105dec869 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:59:36.773451 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-9194926d-2526-4d43-a15c-732105dec869 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 929f91fd-fef7-44e8-8408-763b6b9f1756] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:59:36.779772 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9194926d-2526-4d43-a15c-732105dec869 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:36.780226 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9194926d-2526-4d43-a15c-732105dec869 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:36.780999 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9194926d-2526-4d43-a15c-732105dec869 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:36.781441 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9194926d-2526-4d43-a15c-732105dec869 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:36.908645 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-9194926d-2526-4d43-a15c-732105dec869 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:59:36.915895 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-9194926d-2526-4d43-a15c-732105dec869 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756" status: 200 len: 1265 microversion: 2.1 time: 0.146973 May 12 11:59:36.916472 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 530/1056] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:59:36 2022] GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:59:37.932499 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-854ed9f0-9054-4aee-9547-8ec4c98dfc6a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:59:37.933039 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-854ed9f0-9054-4aee-9547-8ec4c98dfc6a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 929f91fd-fef7-44e8-8408-763b6b9f1756] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:59:37.939974 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-854ed9f0-9054-4aee-9547-8ec4c98dfc6a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:37.940431 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-854ed9f0-9054-4aee-9547-8ec4c98dfc6a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:37.941202 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-854ed9f0-9054-4aee-9547-8ec4c98dfc6a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:37.941643 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-854ed9f0-9054-4aee-9547-8ec4c98dfc6a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:38.068227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-854ed9f0-9054-4aee-9547-8ec4c98dfc6a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:59:38.075563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-854ed9f0-9054-4aee-9547-8ec4c98dfc6a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756" status: 200 len: 1265 microversion: 2.1 time: 0.147132 May 12 11:59:38.076126 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 527/1057] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:59:37 2022] GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:59:39.092381 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-9ad49f72-93a2-4253-9878-fd4ce63aa144 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:59:39.093118 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-9ad49f72-93a2-4253-9878-fd4ce63aa144 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 929f91fd-fef7-44e8-8408-763b6b9f1756] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:59:39.099425 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9ad49f72-93a2-4253-9878-fd4ce63aa144 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:39.099884 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9ad49f72-93a2-4253-9878-fd4ce63aa144 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:39.100661 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9ad49f72-93a2-4253-9878-fd4ce63aa144 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:39.101103 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-9ad49f72-93a2-4253-9878-fd4ce63aa144 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:39.228661 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-9ad49f72-93a2-4253-9878-fd4ce63aa144 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:59:39.236769 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-9ad49f72-93a2-4253-9878-fd4ce63aa144 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756" status: 200 len: 1265 microversion: 2.1 time: 0.148285 May 12 11:59:39.237340 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 531/1058] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:59:39 2022] GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:59:40.254088 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-5698cb21-6931-4bd4-9592-c87ea583bece tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:59:40.255407 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-5698cb21-6931-4bd4-9592-c87ea583bece tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 929f91fd-fef7-44e8-8408-763b6b9f1756] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:59:40.261830 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5698cb21-6931-4bd4-9592-c87ea583bece tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:40.262276 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5698cb21-6931-4bd4-9592-c87ea583bece tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:40.263030 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5698cb21-6931-4bd4-9592-c87ea583bece tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:40.263462 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-5698cb21-6931-4bd4-9592-c87ea583bece tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:40.388776 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-5698cb21-6931-4bd4-9592-c87ea583bece tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:59:40.396610 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-5698cb21-6931-4bd4-9592-c87ea583bece tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756" status: 200 len: 1265 microversion: 2.1 time: 0.146956 May 12 11:59:40.397179 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 528/1059] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:59:40 2022] GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:59:40.691227 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-2109f664-9de5-48ec-9805-c4564555795b req-5d0a155d-6e39-4311-baa4-3bb045d06ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "929f91fd-fef7-44e8-8408-763b6b9f1756", "name": "network-vif-plugged", "status": "completed", "tag": "2316771b-57d5-4858-92fd-b8bf2c80c60b"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:59:40.699979 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-2109f664-9de5-48ec-9805-c4564555795b req-5d0a155d-6e39-4311-baa4-3bb045d06ddf service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:40.700428 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-2109f664-9de5-48ec-9805-c4564555795b req-5d0a155d-6e39-4311-baa4-3bb045d06ddf service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:40.711580 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-2109f664-9de5-48ec-9805-c4564555795b req-5d0a155d-6e39-4311-baa4-3bb045d06ddf service nova] Creating event network-vif-plugged:2316771b-57d5-4858-92fd-b8bf2c80c60b for instance 929f91fd-fef7-44e8-8408-763b6b9f1756 on hv-cinder-80473 May 12 11:59:40.716541 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-2109f664-9de5-48ec-9805-c4564555795b req-5d0a155d-6e39-4311-baa4-3bb045d06ddf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030332 May 12 11:59:40.717120 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 532/1060] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:59:41.413165 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-3d119bc1-cdd3-4f02-8f8e-ee0cc4c0d0fd tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:59:41.413822 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-3d119bc1-cdd3-4f02-8f8e-ee0cc4c0d0fd tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 929f91fd-fef7-44e8-8408-763b6b9f1756] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:59:41.420138 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3d119bc1-cdd3-4f02-8f8e-ee0cc4c0d0fd tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:41.420673 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3d119bc1-cdd3-4f02-8f8e-ee0cc4c0d0fd tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:41.421432 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3d119bc1-cdd3-4f02-8f8e-ee0cc4c0d0fd tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:41.421893 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-3d119bc1-cdd3-4f02-8f8e-ee0cc4c0d0fd tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:41.549746 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-3d119bc1-cdd3-4f02-8f8e-ee0cc4c0d0fd tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:59:41.556931 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-3d119bc1-cdd3-4f02-8f8e-ee0cc4c0d0fd tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756" status: 200 len: 1265 microversion: 2.1 time: 0.147609 May 12 11:59:41.557496 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 529/1061] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:59:41 2022] GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:59:42.575752 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-7d963c69-202e-40a3-bff8-04e7b0fd1c4f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:59:42.576460 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-7d963c69-202e-40a3-bff8-04e7b0fd1c4f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 929f91fd-fef7-44e8-8408-763b6b9f1756] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:59:42.582696 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7d963c69-202e-40a3-bff8-04e7b0fd1c4f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:42.583152 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7d963c69-202e-40a3-bff8-04e7b0fd1c4f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:42.583921 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7d963c69-202e-40a3-bff8-04e7b0fd1c4f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:42.584368 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-7d963c69-202e-40a3-bff8-04e7b0fd1c4f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:42.716169 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-7d963c69-202e-40a3-bff8-04e7b0fd1c4f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:59:42.723949 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-7d963c69-202e-40a3-bff8-04e7b0fd1c4f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756" status: 200 len: 1453 microversion: 2.1 time: 0.152903 May 12 11:59:42.724517 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 533/1062] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:59:42 2022] GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:59:42.740465 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-38dd3557-188e-47dc-bd6c-fda97265270f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 11:59:42.741074 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-38dd3557-188e-47dc-bd6c-fda97265270f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 929f91fd-fef7-44e8-8408-763b6b9f1756] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 11:59:42.747306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-38dd3557-188e-47dc-bd6c-fda97265270f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:42.747759 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-38dd3557-188e-47dc-bd6c-fda97265270f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:42.748526 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-38dd3557-188e-47dc-bd6c-fda97265270f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:42.748962 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-38dd3557-188e-47dc-bd6c-fda97265270f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:42.875577 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-38dd3557-188e-47dc-bd6c-fda97265270f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 11:59:42.882886 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-38dd3557-188e-47dc-bd6c-fda97265270f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756" status: 200 len: 1453 microversion: 2.1 time: 0.146153 May 12 11:59:42.883450 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 530/1063] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 11:59:42 2022] GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756 => generated 1453 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 11:59:44.720889 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-e0c75c2f-1a3c-4d43-b7b9-4f014ce2110b req-41ee6563-18c9-445d-9051-3c74facbf1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "929f91fd-fef7-44e8-8408-763b6b9f1756", "tag": "2316771b-57d5-4858-92fd-b8bf2c80c60b"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 11:59:44.729180 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-e0c75c2f-1a3c-4d43-b7b9-4f014ce2110b req-41ee6563-18c9-445d-9051-3c74facbf1e4 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 11:59:44.729725 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-e0c75c2f-1a3c-4d43-b7b9-4f014ce2110b req-41ee6563-18c9-445d-9051-3c74facbf1e4 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 11:59:44.740668 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-e0c75c2f-1a3c-4d43-b7b9-4f014ce2110b req-41ee6563-18c9-445d-9051-3c74facbf1e4 service nova] Creating event network-changed:2316771b-57d5-4858-92fd-b8bf2c80c60b for instance 929f91fd-fef7-44e8-8408-763b6b9f1756 on hv-cinder-80473 May 12 11:59:44.745582 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-e0c75c2f-1a3c-4d43-b7b9-4f014ce2110b req-41ee6563-18c9-445d-9051-3c74facbf1e4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028444 May 12 11:59:44.746229 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 534/1064] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 11:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 11:59:59.901047 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 11:59:59.901942 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Thu May 12 11:59:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 12:00:37.173036 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 12:00:37.173780 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Thu May 12 12:00:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 12:01:14.856046 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-cd8d9314-660e-485a-91a5-d6be12c94f2f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 12:01:14.856585 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-cd8d9314-660e-485a-91a5-d6be12c94f2f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 929f91fd-fef7-44e8-8408-763b6b9f1756] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 12:01:14.859605 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-d1c7ebd3-258c-4db4-9785-f80a91f3d24a req-c345181f-9505-446e-a775-563d9584950a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "929f91fd-fef7-44e8-8408-763b6b9f1756", "tag": "2316771b-57d5-4858-92fd-b8bf2c80c60b"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 12:01:14.865374 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cd8d9314-660e-485a-91a5-d6be12c94f2f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:14.865920 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cd8d9314-660e-485a-91a5-d6be12c94f2f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:14.867243 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cd8d9314-660e-485a-91a5-d6be12c94f2f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:14.867243 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-cd8d9314-660e-485a-91a5-d6be12c94f2f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:14.868652 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-d1c7ebd3-258c-4db4-9785-f80a91f3d24a req-c345181f-9505-446e-a775-563d9584950a service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:14.869343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-d1c7ebd3-258c-4db4-9785-f80a91f3d24a req-c345181f-9505-446e-a775-563d9584950a service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:14.880521 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-d1c7ebd3-258c-4db4-9785-f80a91f3d24a req-c345181f-9505-446e-a775-563d9584950a service nova] Creating event network-changed:2316771b-57d5-4858-92fd-b8bf2c80c60b for instance 929f91fd-fef7-44e8-8408-763b6b9f1756 on hv-cinder-80473 May 12 12:01:14.885921 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-d1c7ebd3-258c-4db4-9785-f80a91f3d24a req-c345181f-9505-446e-a775-563d9584950a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032904 May 12 12:01:14.886521 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 535/1065] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 12:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 12:01:14.894526 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-cd8d9314-660e-485a-91a5-d6be12c94f2f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 929f91fd-fef7-44e8-8408-763b6b9f1756] Going to try to terminate instance {{(pid=123507) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 12:01:14.981056 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-cd8d9314-660e-485a-91a5-d6be12c94f2f tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "DELETE /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756" status: 204 len: 0 microversion: 2.1 time: 0.129905 May 12 12:01:14.983398 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 531/1066] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 12:01:14 2022] DELETE /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 12:01:14.995558 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-40955cb0-dcd0-4e7f-b74a-fb224db54233 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 12:01:14.996274 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-40955cb0-dcd0-4e7f-b74a-fb224db54233 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 929f91fd-fef7-44e8-8408-763b6b9f1756] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 12:01:15.002411 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-40955cb0-dcd0-4e7f-b74a-fb224db54233 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:15.002874 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-40955cb0-dcd0-4e7f-b74a-fb224db54233 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:15.003725 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-40955cb0-dcd0-4e7f-b74a-fb224db54233 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:15.004168 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-40955cb0-dcd0-4e7f-b74a-fb224db54233 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:15.272021 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-40955cb0-dcd0-4e7f-b74a-fb224db54233 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 12:01:15.279212 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-40955cb0-dcd0-4e7f-b74a-fb224db54233 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756" status: 200 len: 1577 microversion: 2.1 time: 0.288331 May 12 12:01:15.279958 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 536/1067] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 12:01:14 2022] GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756 => generated 1577 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 12:01:16.296904 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-b04988cd-3a23-40c9-8d3e-3b8624d21e53 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 12:01:16.297605 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-b04988cd-3a23-40c9-8d3e-3b8624d21e53 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 929f91fd-fef7-44e8-8408-763b6b9f1756] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 12:01:16.304539 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b04988cd-3a23-40c9-8d3e-3b8624d21e53 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:16.304989 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b04988cd-3a23-40c9-8d3e-3b8624d21e53 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:16.305784 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b04988cd-3a23-40c9-8d3e-3b8624d21e53 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:16.306228 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-b04988cd-3a23-40c9-8d3e-3b8624d21e53 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:16.503782 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-b04988cd-3a23-40c9-8d3e-3b8624d21e53 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 12:01:16.511227 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-b04988cd-3a23-40c9-8d3e-3b8624d21e53 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756" status: 200 len: 1577 microversion: 2.1 time: 0.218611 May 12 12:01:16.511779 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 532/1068] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 12:01:16 2022] GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756 => generated 1577 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 12:01:17.205731 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-f3bdca57-bcb6-447c-a424-8940c8bc298d req-ef3a9799-5227-4d23-a752-f80eea8da950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "929f91fd-fef7-44e8-8408-763b6b9f1756", "name": "network-vif-deleted", "tag": "2316771b-57d5-4858-92fd-b8bf2c80c60b"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 12:01:17.214603 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-f3bdca57-bcb6-447c-a424-8940c8bc298d req-ef3a9799-5227-4d23-a752-f80eea8da950 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:17.215448 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-f3bdca57-bcb6-447c-a424-8940c8bc298d req-ef3a9799-5227-4d23-a752-f80eea8da950 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:17.225950 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-f3bdca57-bcb6-447c-a424-8940c8bc298d req-ef3a9799-5227-4d23-a752-f80eea8da950 service nova] Creating event network-vif-deleted:2316771b-57d5-4858-92fd-b8bf2c80c60b for instance 929f91fd-fef7-44e8-8408-763b6b9f1756 on hv-cinder-80473 May 12 12:01:17.230506 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-f3bdca57-bcb6-447c-a424-8940c8bc298d req-ef3a9799-5227-4d23-a752-f80eea8da950 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088437 May 12 12:01:17.231219 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 537/1069] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 12:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 12:01:17.529097 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-4ca259ba-5ef7-4778-ae72-d42190fe91e9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 12:01:17.529694 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-4ca259ba-5ef7-4778-ae72-d42190fe91e9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 929f91fd-fef7-44e8-8408-763b6b9f1756] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 12:01:17.535921 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4ca259ba-5ef7-4778-ae72-d42190fe91e9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:17.536378 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4ca259ba-5ef7-4778-ae72-d42190fe91e9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:17.537167 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4ca259ba-5ef7-4778-ae72-d42190fe91e9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:17.537609 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4ca259ba-5ef7-4778-ae72-d42190fe91e9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:17.570946 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4ca259ba-5ef7-4778-ae72-d42190fe91e9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:17.571402 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-4ca259ba-5ef7-4778-ae72-d42190fe91e9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:17.571857 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.objects.instance [None req-4ca259ba-5ef7-4778-ae72-d42190fe91e9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lazy-loading 'fault' on Instance uuid 929f91fd-fef7-44e8-8408-763b6b9f1756 {{(pid=123507) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 12:01:17.611783 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-4ca259ba-5ef7-4778-ae72-d42190fe91e9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 12:01:17.619540 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-4ca259ba-5ef7-4778-ae72-d42190fe91e9 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756" status: 200 len: 1229 microversion: 2.1 time: 0.094610 May 12 12:01:17.620104 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 533/1070] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 12:01:17 2022] GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756 => generated 1229 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 12:01:18.638615 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-84bccc1b-c874-4252-8f91-d748582cc3d7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 12:01:18.639318 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-84bccc1b-c874-4252-8f91-d748582cc3d7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 929f91fd-fef7-44e8-8408-763b6b9f1756] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 12:01:18.646278 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-84bccc1b-c874-4252-8f91-d748582cc3d7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:18.646731 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-84bccc1b-c874-4252-8f91-d748582cc3d7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:18.647503 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-84bccc1b-c874-4252-8f91-d748582cc3d7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:18.647952 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-84bccc1b-c874-4252-8f91-d748582cc3d7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:18.661116 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-84bccc1b-c874-4252-8f91-d748582cc3d7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] HTTP exception thrown: Instance 929f91fd-fef7-44e8-8408-763b6b9f1756 could not be found. May 12 12:01:18.662803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-84bccc1b-c874-4252-8f91-d748582cc3d7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Request method failure captured: May 12 12:01:18.662803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756 HTTP/1.1 May 12 12:01:18.662803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 12:01:18.662803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 12:01:18.662803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 12:01:18.662803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 12:01:18.662803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 12:01:18.662803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 12:01:18.662803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 12:01:18.662803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 12:01:18.662803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPWL8OnqDnmwYgCgjxLIlhwqAo5ZG3lmf_-Pcie_BprC53ar7_a_-vV6BIbnllRdm9elV2kVnhXq6PFaOSFPs-fxxao0jwLD7lBO5x4I9UNFuy_7bA8AaP5B7_HC-ZfmUhVwqs7CCs_nVRoFalYYs8k1Q9RDrC19dPhoJFrEhvrcdss May 12 12:01:18.662803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 12:01:18.662803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 12:01:18.662803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 12:01:18.662803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 12:01:18.662803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 12:01:18.662803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 12:01:18.662803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: 7d148f892d044444b6be65537ba8b335 May 12 12:01:18.662803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-TestVolumeBootPattern-2058455156 May 12 12:01:18.662803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 12:01:18.662803 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 12:01:18.664597 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d148f892d044444b6be65537ba8b335"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d148f892d044444b6be65537ba8b335"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d148f892d044444b6be65537ba8b335"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d148f892d044444b6be65537ba8b335", "adminURL": "http://10.222.0.58:8080"}]}] May 12 12:01:18.664597 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-TestVolumeBootPattern-2058455156 May 12 12:01:18.664597 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: 7d148f892d044444b6be65537ba8b335 May 12 12:01:18.664597 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-TestVolumeBootPattern-2058455156 May 12 12:01:18.664597 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-TestVolumeBootPattern-2058455156-project May 12 12:01:18.664597 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 12:01:18.664597 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 12:01:18.664597 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: f6b3ad012ab1404b88e4b36c80a02a05 May 12 12:01:18.664597 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-TestVolumeBootPattern-2058455156-project May 12 12:01:18.664597 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 12:01:18.664597 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance 929f91fd-fef7-44e8-8408-763b6b9f1756 could not be found. May 12 12:01:18.664597 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': '929f91fd-fef7-44e8-8408-763b6b9f1756'} May 12 12:01:18.666343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 12:01:18.666343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 12:01:18.666343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 12:01:18.666343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 12:01:18.666343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 12:01:18.666343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 12:01:18.666343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 12:01:18.666343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 12:01:18.666343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 12:01:18.666343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 12:01:18.666343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 929f91fd-fef7-44e8-8408-763b6b9f1756 could not be found. May 12 12:01:18.666343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 12:01:18.666343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 12:01:18.666343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 12:01:18.666343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 12:01:18.666343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 12:01:18.666343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 12:01:18.666343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 12:01:18.666343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 12:01:18.666343 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 12:01:18.668137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 12:01:18.668137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 12:01:18.668137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 12:01:18.668137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 12:01:18.668137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 12:01:18.668137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 12:01:18.668137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 12:01:18.668137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 929f91fd-fef7-44e8-8408-763b6b9f1756 could not be found. May 12 12:01:18.668137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 12:01:18.668137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 12:01:18.668137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 12:01:18.668137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 12:01:18.668137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 12:01:18.668137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 12:01:18.668137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 12:01:18.668137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 12:01:18.668137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 929f91fd-fef7-44e8-8408-763b6b9f1756 could not be found. May 12 12:01:18.668137 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 12:01:18.669601 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-84bccc1b-c874-4252-8f91-d748582cc3d7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Returning 404 to user: Instance 929f91fd-fef7-44e8-8408-763b6b9f1756 could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 12:01:18.669601 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-84bccc1b-c874-4252-8f91-d748582cc3d7 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756" status: 404 len: 111 microversion: 2.1 time: 0.030353 May 12 12:01:18.669601 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 538/1071] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 12:01:18 2022] GET /compute/v2.1/servers/929f91fd-fef7-44e8-8408-763b6b9f1756 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 12:01:21.975988 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-d215dfd9-b6dd-44b1-b7f1-49d09bd4754a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 12:01:21.976905 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d215dfd9-b6dd-44b1-b7f1-49d09bd4754a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: e38e78e7-9790-415b-a254-a5b794734d23] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 12:01:21.978445 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-49cb5c9c-1738-4e25-bbf6-e7bafb5958e3 req-e8f37f3f-521a-482a-a39f-1f0d1a6bc64e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e38e78e7-9790-415b-a254-a5b794734d23", "tag": "d5593789-16d7-43e5-a19d-5bf1ce2948cc"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 12:01:21.983661 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d215dfd9-b6dd-44b1-b7f1-49d09bd4754a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:21.984186 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d215dfd9-b6dd-44b1-b7f1-49d09bd4754a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:21.985067 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d215dfd9-b6dd-44b1-b7f1-49d09bd4754a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:21.985656 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-d215dfd9-b6dd-44b1-b7f1-49d09bd4754a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:21.988233 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-49cb5c9c-1738-4e25-bbf6-e7bafb5958e3 req-e8f37f3f-521a-482a-a39f-1f0d1a6bc64e service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:21.988696 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-49cb5c9c-1738-4e25-bbf6-e7bafb5958e3 req-e8f37f3f-521a-482a-a39f-1f0d1a6bc64e service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:22.002577 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-49cb5c9c-1738-4e25-bbf6-e7bafb5958e3 req-e8f37f3f-521a-482a-a39f-1f0d1a6bc64e service nova] Creating event network-changed:d5593789-16d7-43e5-a19d-5bf1ce2948cc for instance e38e78e7-9790-415b-a254-a5b794734d23 on hv-cinder-80473 May 12 12:01:22.008044 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-49cb5c9c-1738-4e25-bbf6-e7bafb5958e3 req-e8f37f3f-521a-482a-a39f-1f0d1a6bc64e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033146 May 12 12:01:22.008874 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 539/1072] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 12:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 12:01:22.012081 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-d215dfd9-b6dd-44b1-b7f1-49d09bd4754a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: e38e78e7-9790-415b-a254-a5b794734d23] Going to try to terminate instance {{(pid=123507) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 12:01:22.099471 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-d215dfd9-b6dd-44b1-b7f1-49d09bd4754a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23" status: 204 len: 0 microversion: 2.1 time: 0.127739 May 12 12:01:22.100473 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 534/1073] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 12:01:21 2022] DELETE /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 12:01:22.110687 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-8d4dd3f7-f6fe-4088-a63f-2a39b8a55b1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 12:01:22.111614 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-8d4dd3f7-f6fe-4088-a63f-2a39b8a55b1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: e38e78e7-9790-415b-a254-a5b794734d23] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 12:01:22.120709 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8d4dd3f7-f6fe-4088-a63f-2a39b8a55b1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:22.121177 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8d4dd3f7-f6fe-4088-a63f-2a39b8a55b1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:22.122188 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8d4dd3f7-f6fe-4088-a63f-2a39b8a55b1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:22.122633 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-8d4dd3f7-f6fe-4088-a63f-2a39b8a55b1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:22.275589 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.policy [None req-8d4dd3f7-f6fe-4088-a63f-2a39b8a55b1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123508) authorize /opt/stack/nova/nova/policy.py:199}} May 12 12:01:22.283085 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-8d4dd3f7-f6fe-4088-a63f-2a39b8a55b1a tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23" status: 200 len: 1578 microversion: 2.1 time: 0.178203 May 12 12:01:22.283705 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 540/1074] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 12:01:22 2022] GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23 => generated 1578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 12:01:23.302196 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-369cc2f1-c7fd-4b0f-8516-8323dfa12f9e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 12:01:23.302898 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-369cc2f1-c7fd-4b0f-8516-8323dfa12f9e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: e38e78e7-9790-415b-a254-a5b794734d23] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 12:01:23.309234 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-369cc2f1-c7fd-4b0f-8516-8323dfa12f9e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:23.309677 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-369cc2f1-c7fd-4b0f-8516-8323dfa12f9e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:23.310469 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-369cc2f1-c7fd-4b0f-8516-8323dfa12f9e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:23.310900 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-369cc2f1-c7fd-4b0f-8516-8323dfa12f9e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:23.443630 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-369cc2f1-c7fd-4b0f-8516-8323dfa12f9e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 12:01:23.451241 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-369cc2f1-c7fd-4b0f-8516-8323dfa12f9e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23" status: 200 len: 1578 microversion: 2.1 time: 0.153335 May 12 12:01:23.452012 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 535/1075] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 12:01:23 2022] GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 12:01:24.208616 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [req-ea806065-950d-4abb-9ca7-9d545aa558f6 req-a24848fb-57be-48fc-85d7-afd6679843e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e38e78e7-9790-415b-a254-a5b794734d23", "name": "network-vif-deleted", "tag": "d5593789-16d7-43e5-a19d-5bf1ce2948cc"}]} {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 12:01:24.217744 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-ea806065-950d-4abb-9ca7-9d545aa558f6 req-a24848fb-57be-48fc-85d7-afd6679843e3 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:24.218263 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [req-ea806065-950d-4abb-9ca7-9d545aa558f6 req-a24848fb-57be-48fc-85d7-afd6679843e3 service nova] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:24.229951 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.compute.server_external_events [req-ea806065-950d-4abb-9ca7-9d545aa558f6 req-a24848fb-57be-48fc-85d7-afd6679843e3 service nova] Creating event network-vif-deleted:d5593789-16d7-43e5-a19d-5bf1ce2948cc for instance e38e78e7-9790-415b-a254-a5b794734d23 on hv-cinder-80473 May 12 12:01:24.235414 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [req-ea806065-950d-4abb-9ca7-9d545aa558f6 req-a24848fb-57be-48fc-85d7-afd6679843e3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030414 May 12 12:01:24.236246 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 541/1076] 10.222.0.58 () {64 vars in 1317 bytes} [Thu May 12 12:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 12:01:24.468816 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-2f2ea72e-9c0a-4013-b336-af9eecf73f78 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 12:01:24.469420 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-2f2ea72e-9c0a-4013-b336-af9eecf73f78 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: e38e78e7-9790-415b-a254-a5b794734d23] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 12:01:24.476388 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2f2ea72e-9c0a-4013-b336-af9eecf73f78 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:24.476836 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2f2ea72e-9c0a-4013-b336-af9eecf73f78 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:24.477610 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2f2ea72e-9c0a-4013-b336-af9eecf73f78 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:24.478068 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-2f2ea72e-9c0a-4013-b336-af9eecf73f78 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:24.555306 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.policy [None req-2f2ea72e-9c0a-4013-b336-af9eecf73f78 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3ad012ab1404b88e4b36c80a02a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d148f892d044444b6be65537ba8b335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123507) authorize /opt/stack/nova/nova/policy.py:199}} May 12 12:01:24.563554 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-2f2ea72e-9c0a-4013-b336-af9eecf73f78 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23" status: 200 len: 1225 microversion: 2.1 time: 0.098735 May 12 12:01:24.568963 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 536/1077] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 12:01:24 2022] GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 12:01:25.581723 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-1da19cef-ed97-4e6b-b0d7-4cf1f84289a3 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 12:01:25.582434 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-1da19cef-ed97-4e6b-b0d7-4cf1f84289a3 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: e38e78e7-9790-415b-a254-a5b794734d23] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 12:01:25.588507 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1da19cef-ed97-4e6b-b0d7-4cf1f84289a3 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:25.589207 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1da19cef-ed97-4e6b-b0d7-4cf1f84289a3 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:25.589988 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1da19cef-ed97-4e6b-b0d7-4cf1f84289a3 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:25.590417 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-1da19cef-ed97-4e6b-b0d7-4cf1f84289a3 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:25.603724 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-1da19cef-ed97-4e6b-b0d7-4cf1f84289a3 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] HTTP exception thrown: Instance e38e78e7-9790-415b-a254-a5b794734d23 could not be found. May 12 12:01:25.605329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-1da19cef-ed97-4e6b-b0d7-4cf1f84289a3 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Request method failure captured: May 12 12:01:25.605329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23 HTTP/1.1 May 12 12:01:25.605329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 12:01:25.605329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 12:01:25.605329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 12:01:25.605329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 12:01:25.605329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 12:01:25.605329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 12:01:25.605329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 12:01:25.605329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 12:01:25.605329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPWL8OnqDnmwYgCgjxLIlhwqAo5ZG3lmf_-Pcie_BprC53ar7_a_-vV6BIbnllRdm9elV2kVnhXq6PFaOSFPs-fxxao0jwLD7lBO5x4I9UNFuy_7bA8AaP5B7_HC-ZfmUhVwqs7CCs_nVRoFalYYs8k1Q9RDrC19dPhoJFrEhvrcdss May 12 12:01:25.605329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 12:01:25.605329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 12:01:25.605329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 12:01:25.605329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 12:01:25.605329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 12:01:25.605329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 12:01:25.605329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: 7d148f892d044444b6be65537ba8b335 May 12 12:01:25.605329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-TestVolumeBootPattern-2058455156 May 12 12:01:25.605329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 12:01:25.605329 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 12:01:25.606950 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d148f892d044444b6be65537ba8b335"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d148f892d044444b6be65537ba8b335"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d148f892d044444b6be65537ba8b335"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d148f892d044444b6be65537ba8b335", "adminURL": "http://10.222.0.58:8080"}]}] May 12 12:01:25.606950 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-TestVolumeBootPattern-2058455156 May 12 12:01:25.606950 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: 7d148f892d044444b6be65537ba8b335 May 12 12:01:25.606950 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-TestVolumeBootPattern-2058455156 May 12 12:01:25.606950 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-TestVolumeBootPattern-2058455156-project May 12 12:01:25.606950 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 12:01:25.606950 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 12:01:25.606950 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: f6b3ad012ab1404b88e4b36c80a02a05 May 12 12:01:25.606950 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-TestVolumeBootPattern-2058455156-project May 12 12:01:25.606950 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 12:01:25.606950 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance e38e78e7-9790-415b-a254-a5b794734d23 could not be found. May 12 12:01:25.606950 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': 'e38e78e7-9790-415b-a254-a5b794734d23'} May 12 12:01:25.608024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 12:01:25.608024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 12:01:25.608024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 12:01:25.608024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 12:01:25.608024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 12:01:25.608024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 12:01:25.608024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 12:01:25.608024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 12:01:25.608024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 12:01:25.608024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 12:01:25.608024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e38e78e7-9790-415b-a254-a5b794734d23 could not be found. May 12 12:01:25.608024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 12:01:25.608024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 12:01:25.608024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 12:01:25.608024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 12:01:25.608024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 12:01:25.608024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 12:01:25.608024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 12:01:25.608024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 12:01:25.608024 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 12:01:25.609524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 12:01:25.609524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 12:01:25.609524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 12:01:25.609524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 12:01:25.609524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 12:01:25.609524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 12:01:25.609524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 12:01:25.609524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e38e78e7-9790-415b-a254-a5b794734d23 could not be found. May 12 12:01:25.609524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 12:01:25.609524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 12:01:25.609524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 12:01:25.609524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 12:01:25.609524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 12:01:25.609524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 12:01:25.609524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 12:01:25.609524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 12:01:25.609524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e38e78e7-9790-415b-a254-a5b794734d23 could not be found. May 12 12:01:25.609524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 12:01:25.611132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-1da19cef-ed97-4e6b-b0d7-4cf1f84289a3 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Returning 404 to user: Instance e38e78e7-9790-415b-a254-a5b794734d23 could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 12:01:25.611132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-1da19cef-ed97-4e6b-b0d7-4cf1f84289a3 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23" status: 404 len: 111 microversion: 2.1 time: 0.029710 May 12 12:01:25.611132 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 542/1078] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 12:01:25 2022] GET /compute/v2.1/servers/e38e78e7-9790-415b-a254-a5b794734d23 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 12:01:26.036939 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-fbc23129-beba-4d14-94b3-c544386c8328 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 12:01:26.037457 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.compute.api [None req-fbc23129-beba-4d14-94b3-c544386c8328 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] Fetching instance by UUID {{(pid=123507) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 12:01:26.044461 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fbc23129-beba-4d14-94b3-c544386c8328 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:26.044914 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fbc23129-beba-4d14-94b3-c544386c8328 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:26.046040 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fbc23129-beba-4d14-94b3-c544386c8328 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:26.046480 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG oslo_concurrency.lockutils [None req-fbc23129-beba-4d14-94b3-c544386c8328 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:26.059472 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.wsgi [None req-fbc23129-beba-4d14-94b3-c544386c8328 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] HTTP exception thrown: Instance 08861685-923b-4ae7-ac93-e58799f637ab could not be found. May 12 12:01:26.061098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-fbc23129-beba-4d14-94b3-c544386c8328 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Request method failure captured: May 12 12:01:26.061098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: request: DELETE /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab HTTP/1.1 May 12 12:01:26.061098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept: application/json May 12 12:01:26.061098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Accept-Encoding: identity May 12 12:01:26.061098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Connection: close May 12 12:01:26.061098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Length: 0 May 12 12:01:26.061098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Content-Type: application/json May 12 12:01:26.061098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Host: 10.222.0.58 May 12 12:01:26.061098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Openstack-System-Scope: None May 12 12:01:26.061098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: User-Agent: python-urllib3/1.26.9 May 12 12:01:26.061098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Auth-Token: gAAAAABifPWL8OnqDnmwYgCgjxLIlhwqAo5ZG3lmf_-Pcie_BprC53ar7_a_-vV6BIbnllRdm9elV2kVnhXq6PFaOSFPs-fxxao0jwLD7lBO5x4I9UNFuy_7bA8AaP5B7_HC-ZfmUhVwqs7CCs_nVRoFalYYs8k1Q9RDrC19dPhoJFrEhvrcdss May 12 12:01:26.061098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Id: None May 12 12:01:26.061098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Domain-Name: None May 12 12:01:26.061098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Identity-Status: Confirmed May 12 12:01:26.061098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Is-Admin-Project: True May 12 12:01:26.061098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Id: default May 12 12:01:26.061098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Domain-Name: Default May 12 12:01:26.061098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Id: 7d148f892d044444b6be65537ba8b335 May 12 12:01:26.061098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Project-Name: tempest-TestVolumeBootPattern-2058455156 May 12 12:01:26.061098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Role: member,reader May 12 12:01:26.061098 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Roles: member,reader May 12 12:01:26.062724 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d148f892d044444b6be65537ba8b335"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d148f892d044444b6be65537ba8b335"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d148f892d044444b6be65537ba8b335"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d148f892d044444b6be65537ba8b335", "adminURL": "http://10.222.0.58:8080"}]}] May 12 12:01:26.062724 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant: tempest-TestVolumeBootPattern-2058455156 May 12 12:01:26.062724 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Id: 7d148f892d044444b6be65537ba8b335 May 12 12:01:26.062724 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-Tenant-Name: tempest-TestVolumeBootPattern-2058455156 May 12 12:01:26.062724 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User: tempest-TestVolumeBootPattern-2058455156-project May 12 12:01:26.062724 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Id: default May 12 12:01:26.062724 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Domain-Name: Default May 12 12:01:26.062724 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Id: f6b3ad012ab1404b88e4b36c80a02a05 May 12 12:01:26.062724 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: X-User-Name: tempest-TestVolumeBootPattern-2058455156-project May 12 12:01:26.062724 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: method: > May 12 12:01:26.062724 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: exception: Instance 08861685-923b-4ae7-ac93-e58799f637ab could not be found. May 12 12:01:26.062724 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: action_args: {'id': '08861685-923b-4ae7-ac93-e58799f637ab'} May 12 12:01:26.063563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 12:01:26.063563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 12:01:26.063563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 12:01:26.063563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 12:01:26.063563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 12:01:26.063563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 12:01:26.063563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 12:01:26.063563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 12:01:26.063563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 12:01:26.063563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 12:01:26.063563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08861685-923b-4ae7-ac93-e58799f637ab could not be found. May 12 12:01:26.063563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 12:01:26.063563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 12:01:26.063563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 12:01:26.063563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 12:01:26.063563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 12:01:26.063563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 12:01:26.063563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 12:01:26.063563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 12:01:26.063563 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 12:01:26.064901 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 12:01:26.064901 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 12:01:26.064901 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 12:01:26.064901 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 12:01:26.064901 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 12:01:26.064901 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 12:01:26.064901 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 12:01:26.064901 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 12:01:26.064901 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 12:01:26.064901 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08861685-923b-4ae7-ac93-e58799f637ab could not be found. May 12 12:01:26.064901 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 12:01:26.064901 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 12:01:26.064901 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 12:01:26.064901 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 12:01:26.064901 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 12:01:26.064901 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 12:01:26.064901 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 12:01:26.064901 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 12:01:26.064901 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08861685-923b-4ae7-ac93-e58799f637ab could not be found. May 12 12:01:26.064901 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR nova.api.openstack.wsgi May 12 12:01:26.066219 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-fbc23129-beba-4d14-94b3-c544386c8328 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Returning 404 to user: Instance 08861685-923b-4ae7-ac93-e58799f637ab could not be found. {{(pid=123507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 12:01:26.066219 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-fbc23129-beba-4d14-94b3-c544386c8328 tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "DELETE /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab" status: 404 len: 111 microversion: 2.1 time: 0.030096 May 12 12:01:26.066219 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 537/1079] 10.222.0.58 () {58 vars in 1238 bytes} [Thu May 12 12:01:26 2022] DELETE /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 12:01:26.071850 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-0206b42c-2076-446f-b1a1-9533af38c96e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '>' {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 12:01:26.072469 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.compute.api [None req-0206b42c-2076-446f-b1a1-9533af38c96e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [instance: 08861685-923b-4ae7-ac93-e58799f637ab] Fetching instance by UUID {{(pid=123508) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 12:01:26.078361 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0206b42c-2076-446f-b1a1-9533af38c96e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:26.078818 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0206b42c-2076-446f-b1a1-9533af38c96e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:26.079581 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0206b42c-2076-446f-b1a1-9533af38c96e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 12:01:26.080558 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG oslo_concurrency.lockutils [None req-0206b42c-2076-446f-b1a1-9533af38c96e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Lock "7415e0ef-d04b-4a91-9f1a-2fb932d8b170" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 12:01:26.093774 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.wsgi [None req-0206b42c-2076-446f-b1a1-9533af38c96e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] HTTP exception thrown: Instance 08861685-923b-4ae7-ac93-e58799f637ab could not be found. May 12 12:01:26.095268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-0206b42c-2076-446f-b1a1-9533af38c96e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Request method failure captured: May 12 12:01:26.095268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: request: GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab HTTP/1.1 May 12 12:01:26.095268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept: application/json May 12 12:01:26.095268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Accept-Encoding: identity May 12 12:01:26.095268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Connection: close May 12 12:01:26.095268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Length: 0 May 12 12:01:26.095268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Content-Type: application/json May 12 12:01:26.095268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Host: 10.222.0.58 May 12 12:01:26.095268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Openstack-System-Scope: None May 12 12:01:26.095268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: User-Agent: python-urllib3/1.26.9 May 12 12:01:26.095268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Auth-Token: gAAAAABifPWL8OnqDnmwYgCgjxLIlhwqAo5ZG3lmf_-Pcie_BprC53ar7_a_-vV6BIbnllRdm9elV2kVnhXq6PFaOSFPs-fxxao0jwLD7lBO5x4I9UNFuy_7bA8AaP5B7_HC-ZfmUhVwqs7CCs_nVRoFalYYs8k1Q9RDrC19dPhoJFrEhvrcdss May 12 12:01:26.095268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Id: None May 12 12:01:26.095268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Domain-Name: None May 12 12:01:26.095268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Identity-Status: Confirmed May 12 12:01:26.095268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Is-Admin-Project: True May 12 12:01:26.095268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Id: default May 12 12:01:26.095268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Domain-Name: Default May 12 12:01:26.095268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Id: 7d148f892d044444b6be65537ba8b335 May 12 12:01:26.095268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Project-Name: tempest-TestVolumeBootPattern-2058455156 May 12 12:01:26.095268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Role: member,reader May 12 12:01:26.095268 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Roles: member,reader May 12 12:01:26.097399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d148f892d044444b6be65537ba8b335"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d148f892d044444b6be65537ba8b335"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d148f892d044444b6be65537ba8b335"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d148f892d044444b6be65537ba8b335", "adminURL": "http://10.222.0.58:8080"}]}] May 12 12:01:26.097399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant: tempest-TestVolumeBootPattern-2058455156 May 12 12:01:26.097399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Id: 7d148f892d044444b6be65537ba8b335 May 12 12:01:26.097399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-Tenant-Name: tempest-TestVolumeBootPattern-2058455156 May 12 12:01:26.097399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User: tempest-TestVolumeBootPattern-2058455156-project May 12 12:01:26.097399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Id: default May 12 12:01:26.097399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Domain-Name: Default May 12 12:01:26.097399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Id: f6b3ad012ab1404b88e4b36c80a02a05 May 12 12:01:26.097399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: X-User-Name: tempest-TestVolumeBootPattern-2058455156-project May 12 12:01:26.097399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: method: > May 12 12:01:26.097399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: exception: Instance 08861685-923b-4ae7-ac93-e58799f637ab could not be found. May 12 12:01:26.097399 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: action_args: {'id': '08861685-923b-4ae7-ac93-e58799f637ab'} May 12 12:01:26.098594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: {{(pid=123508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 12:01:26.098594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 12:01:26.098594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 12:01:26.098594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 12:01:26.098594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 12:01:26.098594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 12:01:26.098594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 12:01:26.098594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 12:01:26.098594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 12:01:26.098594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 12:01:26.098594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08861685-923b-4ae7-ac93-e58799f637ab could not be found. May 12 12:01:26.098594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 12:01:26.098594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 12:01:26.098594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 12:01:26.098594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 12:01:26.098594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 12:01:26.098594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 12:01:26.098594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 12:01:26.098594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 12:01:26.098594 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 12:01:26.099875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 12:01:26.099875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 12:01:26.099875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 12:01:26.099875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 12:01:26.099875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 12:01:26.099875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 12:01:26.099875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 12:01:26.099875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08861685-923b-4ae7-ac93-e58799f637ab could not be found. May 12 12:01:26.099875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 12:01:26.099875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 12:01:26.099875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 12:01:26.099875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 12:01:26.099875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 12:01:26.099875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 12:01:26.099875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 12:01:26.099875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 12:01:26.099875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08861685-923b-4ae7-ac93-e58799f637ab could not be found. May 12 12:01:26.099875 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: ERROR nova.api.openstack.wsgi May 12 12:01:26.101505 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: DEBUG nova.api.openstack.wsgi [None req-0206b42c-2076-446f-b1a1-9533af38c96e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Returning 404 to user: Instance 08861685-923b-4ae7-ac93-e58799f637ab could not be found. {{(pid=123508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 12:01:26.101505 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO nova.api.openstack.requestlog [None req-0206b42c-2076-446f-b1a1-9533af38c96e tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab" status: 404 len: 111 microversion: 2.1 time: 0.029210 May 12 12:01:26.101505 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: [pid: 123508|app: 0|req: 543/1080] 10.222.0.58 () {58 vars in 1235 bytes} [Thu May 12 12:01:26 2022] GET /compute/v2.1/servers/08861685-923b-4ae7-ac93-e58799f637ab => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 12:01:27.377955 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: DEBUG nova.api.openstack.wsgi [None req-84c4ffc9-137c-4702-bf74-177e0c0c6aef tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] Calling method '.version_select at 0x7f29f1cd0280>' {{(pid=123507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 12:01:27.381161 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: ERROR oslo.messaging._drivers.impl_rabbit [None req-84c4ffc9-137c-4702-bf74-177e0c0c6aef tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [a43d9b00-f580-43e1-8193-f9ad92bff229] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 12 12:01:28.388914 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO oslo.messaging._drivers.impl_rabbit [None req-84c4ffc9-137c-4702-bf74-177e0c0c6aef tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] [a43d9b00-f580-43e1-8193-f9ad92bff229] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 48892. May 12 12:01:28.411240 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO nova.api.openstack.requestlog [None req-84c4ffc9-137c-4702-bf74-177e0c0c6aef tempest-TestVolumeBootPattern-2058455156 tempest-TestVolumeBootPattern-2058455156-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-219476055" status: 202 len: 0 microversion: 2.1 time: 1.037818 May 12 12:01:28.411810 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: [pid: 123507|app: 0|req: 538/1081] 10.222.0.58 () {58 vars in 1259 bytes} [Thu May 12 12:01:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-219476055 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 12:03:19.909558 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 12:03:19.910185 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Thu May 12 12:03:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 12:03:46.285771 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 12:03:46.286454 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Thu May 12 12:03:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 12:03:57.181428 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 12:03:57.182037 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Thu May 12 12:03:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 12:05:15.549993 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 12:05:15.550484 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Thu May 12 12:05:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 12:06:39.922524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 12:06:39.922524 dv-cinder-804735-29-iscsi devstack@n-api.service[123508]: Thu May 12 12:06:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 12:06:44.987892 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 12:06:44.988429 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Thu May 12 12:06:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 12:06:57.607937 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 12:06:57.608502 dv-cinder-804735-29-iscsi devstack@n-api.service[123507]: Thu May 12 12:06:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!